-- Logs begin at Sun 2021-08-29 13:40:27 UTC, end at Sun 2021-08-29 14:57:29 UTC. -- Aug 29 14:17:05.423739 dv-cinder-778193-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 14:17:05.433197 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 14:17:05.435210 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 29 14:17:05 2021] *** Aug 29 14:17:05.435210 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 14:17:05.435210 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 14:17:05.435210 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: nodename: dv-cinder-778193-6-iscsi Aug 29 14:17:05.435210 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: machine: x86_64 Aug 29 14:17:05.435210 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: clock source: unix Aug 29 14:17:05.435210 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: pcre jit disabled Aug 29 14:17:05.435210 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: detected number of CPU cores: 4 Aug 29 14:17:05.435210 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: current working directory: / Aug 29 14:17:05.435210 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: detected binary path: /usr/bin/uwsgi-core Aug 29 14:17:05.435812 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: your processes number limit is 47680 Aug 29 14:17:05.435812 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: your memory page size is 4096 bytes Aug 29 14:17:05.435812 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: detected max file descriptor number: 2048 Aug 29 14:17:05.435812 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: lock engine: pthread robust mutexes Aug 29 14:17:05.435812 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: thunder lock: enabled Aug 29 14:17:05.435812 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 14:17:05.435812 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 29 14:17:05.482095 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: Python main interpreter initialized at 0x559a387e29c0 Aug 29 14:17:05.482095 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: python threads support enabled Aug 29 14:17:05.482095 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: your server socket listen backlog is limited to 100 connections Aug 29 14:17:05.482095 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: your mercy for graceful operations on workers is 90 seconds Aug 29 14:17:05.482464 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 14:17:05.482540 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: *** Operational MODE: preforking *** Aug 29 14:17:05.482783 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: *** uWSGI is running in multiple interpreter mode *** Aug 29 14:17:05.482783 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: spawned uWSGI master process (pid: 73665) Aug 29 14:17:05.482983 dv-cinder-778193-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 29 14:17:05.484251 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: spawned uWSGI worker 1 (pid: 73673, cores: 1) Aug 29 14:17:05.484251 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: spawned uWSGI worker 2 (pid: 73674, cores: 1) Aug 29 14:17:05.484251 dv-cinder-778193-6-iscsi devstack@keystone.service[73665]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 14:17:10.531402 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 14:17:10.531402 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: from cryptography.utils import int_from_bytes Aug 29 14:17:10.532198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 14:17:10.532198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: from cryptography.utils import int_from_bytes Aug 29 14:17:10.532309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 14:17:10.532309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: from cryptography.utils import int_from_bytes Aug 29 14:17:10.532309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 14:17:10.532309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: from cryptography.utils import int_from_bytes Aug 29 14:17:10.580634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 14:17:10.580831 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 14:17:10.580925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 14:17:10.581018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 14:17:10.581101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] command line args: [] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 14:17:10.581256 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] command line args: [] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 14:17:10.581338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 14:17:10.581416 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 14:17:10.581488 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ================================================================================ {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 14:17:10.581565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ================================================================================ {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 14:17:10.581646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] admin_token = **** {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.581724 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] admin_token = **** {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.581879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] config_dir = [] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.581974 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] config_dir = [] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.582075 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.582161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.582242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] config_source = [] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.582319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] config_source = [] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.582417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] debug = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.582504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] debug = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.582611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.582921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.583056 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.583155 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.583276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.583386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.583386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.583582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.583681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.583777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.583879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] list_limit = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.583981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] list_limit = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.584095 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] log_config_append = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.584199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] log_config_append = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.584295 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.584390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.584498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] log_dir = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.584594 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] log_dir = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.584702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] log_file = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.584800 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] log_file = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.584923 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.585005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.585077 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.585154 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.585233 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.585305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.585376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.585456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.586088 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.586276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.586355 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.586483 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.586566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.586643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.586770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.586863 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.586938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.587143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.587234 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.587308 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.587379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.587457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.587580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.587713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.587829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.587993 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.588091 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.588184 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.588358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.588442 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.588858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.588950 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.589077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] publish_errors = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.589152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] publish_errors = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.589259 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.589342 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.589485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.589566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.589642 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.589718 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.589895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.589994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.590133 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.590218 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.590364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] standard_threads = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.590448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] standard_threads = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.590589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.590665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.590827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.590905 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.591000 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.591087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.591158 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] use_journal = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.591263 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] use_journal = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.591345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] use_json = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.591465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] use_json = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.591543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] use_stderr = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.591622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] use_stderr = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.591692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] use_syslog = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.591822 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] use_syslog = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.591937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.592057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 14:17:10.592170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.592293 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.592414 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.592528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.592641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.592753 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.592865 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.592986 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.593111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.593231 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.593352 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.593451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.593551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.593646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.593752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.593855 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.593980 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.594086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.594188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.594291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.594407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.594523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.594635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.594748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.594867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.594980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.595101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.595216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.595343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.595461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.595575 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.595693 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.595879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.595995 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.596199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.596329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.596491 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.596605 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.596727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.596848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.596963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.597076 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.597195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.597311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.597435 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.597550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.597663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.597777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.597916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.598041 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.598237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.598352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.598471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.598585 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.598585 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.598804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.598918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.599030 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.599260 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.599391 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.599513 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.599635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.599755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.599911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.600032 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.600145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.600427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.600556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.600672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.600794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.600909 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.601023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.601898 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.602114 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.602254 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.602381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.602498 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.602611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.602730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.602849 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.602962 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.602962 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.603195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.603352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.603469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.603684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.603815 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.603930 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.604043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.604162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.604162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.604375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.604507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.604634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.604754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.604868 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.604980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.605092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.605092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.605312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.605425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.605537 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.605537 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.605755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.605755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.606037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.606153 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.606266 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.606378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.606490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.606611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.606726 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.606839 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.606951 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.607063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.607175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.607299 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.607413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.607525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.607649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.607770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.607883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.608004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.608118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.608232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.608352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.608466 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.608591 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.608712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.608839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.608954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.609067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.609179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.609291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.609411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.609531 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.609645 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.609758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.609885 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.610000 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.610127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.610242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.610355 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.610467 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.610580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.610692 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.610815 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.610931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.611044 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.611157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.611269 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.611381 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.611509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.611624 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.611737 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.611849 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.611963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.612077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.612197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.612311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.612429 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.612542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.612661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.612775 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.612898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.613014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.613127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.613239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.613352 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.613352 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.613570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.613685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.613812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.613953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.614069 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.614181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.614305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.614419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.614532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.614645 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.614763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.614877 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.614998 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.615119 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.615233 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.615345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.615457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] auth.external = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.615569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] auth.external = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.615690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.615804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.615917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.616030 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.616150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.616264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.616451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] auth.password = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.616567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] auth.password = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.616686 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] auth.token = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.616979 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] auth.token = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.617102 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.617218 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.617340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.617455 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.617569 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.617682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.617795 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.617923 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.618093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.618217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.618331 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.618543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.618712 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.618829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.618951 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] credential.caching = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.618951 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.619204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] credential.caching = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.619204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.619421 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.619535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.619654 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.619654 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.619875 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.619990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.620103 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.620223 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.620344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.620344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.620611 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.620733 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.620848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.620961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.621075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.621196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.621312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.621426 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.621546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.621661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.621775 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.621952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.622077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.622192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.622305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.622426 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.622540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.622661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.622776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] federation.caching = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.622889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] federation.caching = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.623003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.623116 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.623229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.623353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.623470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.623583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.623696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.623809 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.623922 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.624043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.624158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.624271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.624384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.624498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.624612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.624732 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.624847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.625046 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.625167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.625323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.625443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.625567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.625683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.caching = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.625797 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.caching = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.625926 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.626041 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.626155 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.626281 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.626397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.626511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.626626 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.626740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.626854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.626975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.627090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.627204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.627317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.627438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.627553 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.627676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.627791 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.627905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.628018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.628131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.628244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.628369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.628537 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.628656 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.628876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.628996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.629156 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.629284 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.629400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.629520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.629635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.629750 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.629920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.630051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.630168 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.630282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.630395 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.630509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.630630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.630746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.630860 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.630973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.631086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.631199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.631320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.631435 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.631548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.631661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.631774 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.631925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.632056 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.632236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.632358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.632506 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.632621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.632734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.632920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.633036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.633149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.633263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.633376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.633489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.633615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.633731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.633845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.633982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.634097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.634210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.634336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.634452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.634566 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.634679 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.634792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.634905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.635027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.635142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.635256 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.635368 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.635481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.635594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.635723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.635723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.635938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.636052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.636166 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.636278 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.636399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.636514 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.636626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.636748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.636862 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.636976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.637099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.637214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.637327 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.637440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.637559 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.638040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.638170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.638289 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.638402 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.638521 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.638635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.638748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.638869 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.638983 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.639097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.639211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.639323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.639436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.639557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.639672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.639785 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.639898 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.640011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.640124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.640246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.640361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.640474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.640587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.640699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.640812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.640933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.641048 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.641161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.641276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.641389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.641502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.641623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.641738 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.641851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.641984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.642097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.642210 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.642336 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.642451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.642564 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.642676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.642789 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.642901 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.643026 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.643140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.643253 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.643367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.643480 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.643592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.643712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.643827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.643939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.643939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.644150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.644150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.644369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.644369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.644584 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.644584 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.644795 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.644915 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.645037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.645152 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.645265 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.645265 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.645478 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.645598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.645712 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.645825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.645968 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.646082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.646194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.646319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.646434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.646548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.646661 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.646774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.646887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] resource.caching = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.647007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] resource.caching = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.647122 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.647235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.647347 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.647460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.647574 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.647695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.647810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.647927 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.648688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.648812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.648927 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.649050 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.649166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.649279 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.649394 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.649508 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.649621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.649744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.649886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] role.caching = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.650003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] role.caching = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.650129 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] role.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.650244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] role.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.650358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.650480 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.650596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.650711 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.650824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.650938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.651052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.651173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.651289 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.651409 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.651524 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.651638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.651753 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.651753 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.651977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.652090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.652204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.652317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.652480 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.652605 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.652806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.652930 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.653086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.653208 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.653321 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.653453 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.653580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.653580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.653796 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.653796 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.654072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.654189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.654304 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.654417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.654530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.654644 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.654805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.654805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.655029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.655029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.655242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.655242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.655464 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.655580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.655694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.655807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.655921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.656035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.656225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.656342 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.656456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.656570 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.656684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.656797 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.656918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.657034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.657149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.657261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.657375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.657488 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.657609 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.657725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.657838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.657967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.658082 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.658195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.658324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] token.caching = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.658440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] token.caching = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.658554 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.658667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.658781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.658894 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.659019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.659142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.659257 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.659456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.659580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.659737 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.659866 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.659982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.660096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.660211 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.660324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.660437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.660559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.660675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.660789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.660903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.661016 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.661130 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.661258 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.661375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.661488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.661602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.661715 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.661829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.662030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.662147 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.662262 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.662381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.662496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.662609 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.662770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.connection = **** {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.662891 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.connection = **** {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.663106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.663232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.663388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.663515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.664224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.664352 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.664467 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.664581 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.664847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.664963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.665089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.665206 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.665319 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.665434 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.665548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.665661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.665782 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.665915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.666030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.666144 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.666257 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.666384 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.666517 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.666641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.666756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.666878 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.666994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.667115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.667230 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.667344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.667467 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.667583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.667696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.667810 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.667924 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.668038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 14:17:10.668160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 14:17:10.668276 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 14:17:10.694036 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.694183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.694311 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.694388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.694481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.694560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.703423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.703705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.731667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.731892 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.732292 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.732527 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.784547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.785110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.838249 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.838499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.902045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.902275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.908060 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.908296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.908530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.908745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.908961 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.909175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.947342 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.947598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.947768 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.947982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.948195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.948406 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.971013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.971240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.971466 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.971688 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.971904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.972114 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.972323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.984728 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.997931 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.998162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.998389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.998610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.998825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.999080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:10.999240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.007120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.007351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.008118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.008436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.008824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.009042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.009254 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.017028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.017148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.017232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 14:17:11.017558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.017759 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 14:17:11.018046 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.018303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.018554 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.018804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.020194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.020427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.020645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.020861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.021073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.021284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.021494 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 14:17:11.029326 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.029597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.029879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.030159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.031687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.031896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 14:17:11.032235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.032434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 14:17:11.032908 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.033169 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.033432 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.033689 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.038276 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.042029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.042302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.042578 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.042856 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.043132 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.043387 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.043649 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.043916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.044179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.044451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.044710 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.044944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.045219 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.045496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.045779 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.053929 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.057748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.058041 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.058321 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.058614 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.058893 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.059157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.059434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.059702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.059981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.060250 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.060519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.071231 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.073084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.073084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.081955 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.082437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.082719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.087268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.088865 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.089152 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.090567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.090843 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.094535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.094810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.095195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.095282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.095480 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.095753 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.096028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.096297 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.096566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.096829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.097090 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.103240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.103519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.107948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.108233 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.108519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.108798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.109078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.109349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.109615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.109914 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.115883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.116152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.120686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.124272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.124665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.128708 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.128982 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.129683 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.133302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.133477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.136858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.137077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.137164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.137368 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.137452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.137971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.138248 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.138533 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.142669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.146231 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.150675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.150978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.151261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.151547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.151827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.152101 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.158283 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.158562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.158824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.159080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.167343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.168995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.169264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.171573 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.171858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.172124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.172377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.172462 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.172653 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.172932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.173207 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.173489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.180183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.181849 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.182145 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.185263 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.185547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.185828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.186138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.186414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.186541 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.186812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.187086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.187360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.187727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.188001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.188276 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.200455 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.200736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.201014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.201294 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.202979 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.203270 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.203559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.205885 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.209061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.212906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.215762 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.217359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.217632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.217953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.221593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.224827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.225014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.227422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.228665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.230394 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.230591 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.230875 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.231287 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.231562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.231997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.232275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.232557 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.239667 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.240438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.240720 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.240996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.241254 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.244502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.244794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.245180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.245468 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.248918 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.249195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.249467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.249741 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.250028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.250395 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.250680 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.250946 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.251210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.251472 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.251755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.252010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.252282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.252537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.254379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.254678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.254958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.262928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 14:17:11.263204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.263479 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.263756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.264031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.264399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.264671 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.264948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.265217 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.265500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.265774 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.266058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.266328 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.266602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 14:17:11.290872 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a387e29c0 pid: 73674 (default app) Aug 29 14:17:11.294181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c6931-064d-4e66-9e57-96a0aaf54f5f None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:11.294470 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c6931-064d-4e66-9e57-96a0aaf54f5f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:11.294742 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c6931-064d-4e66-9e57-96a0aaf54f5f None None] PATH_INFO: `/v3` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:11.298862 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 792 bytes} [Sun Aug 29 14:17:11 2021] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:11.304799 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a387e29c0 pid: 73673 (default app) Aug 29 14:17:19.935581 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59731ec0-f5e1-42c3-859f-3d6b2fdd7a17 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:19.936105 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59731ec0-f5e1-42c3-859f-3d6b2fdd7a17 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:19.936187 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59731ec0-f5e1-42c3-859f-3d6b2fdd7a17 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:19.938256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:17:19.946385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45f8d-57be-48e5-a1be-4ae77585b058 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:19.946811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45f8d-57be-48e5-a1be-4ae77585b058 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:19.946934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45f8d-57be-48e5-a1be-4ae77585b058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:19.977844 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG oslo_db.sqlalchemy.engines [None req-61f45f8d-57be-48e5-a1be-4ae77585b058 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 14:17:20.166952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG passlib.handlers.bcrypt [None req-61f45f8d-57be-48e5-a1be-4ae77585b058 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73673) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 14:17:20.167381 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG passlib.handlers.bcrypt [None req-61f45f8d-57be-48e5-a1be-4ae77585b058 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73673) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 14:17:20.222043 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-61f45f8d-57be-48e5-a1be-4ae77585b058 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:20.223582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-61f45f8d-57be-48e5-a1be-4ae77585b058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:20.374433 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1/3] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:20.490018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59731ec0-f5e1-42c3-859f-3d6b2fdd7a17 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:20.524080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG oslo_db.sqlalchemy.engines [None req-59731ec0-f5e1-42c3-859f-3d6b2fdd7a17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 14:17:20.671411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59731ec0-f5e1-42c3-859f-3d6b2fdd7a17 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:20.675622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8ae11-c7c1-4d0b-b9c3-919b70e28a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:20.676273 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8ae11-c7c1-4d0b-b9c3-919b70e28a77 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:20.676552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8ae11-c7c1-4d0b-b9c3-919b70e28a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:20.676822 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8ae11-c7c1-4d0b-b9c3-919b70e28a77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:20.684811 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8ae11-c7c1-4d0b-b9c3-919b70e28a77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:20.735045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b1b8ae11-c7c1-4d0b-b9c3-919b70e28a77 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 14:17:20.735382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8ae11-c7c1-4d0b-b9c3-919b70e28a77 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:20.744829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:20.751411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45f8d-57be-48e5-a1be-4ae77585b058 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:20.766053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45f8d-57be-48e5-a1be-4ae77585b058 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:20.770487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36054921-151e-4ac9-8de3-117406f1a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:20.771580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36054921-151e-4ac9-8de3-117406f1a173 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:20.771860 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36054921-151e-4ac9-8de3-117406f1a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:20.772131 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36054921-151e-4ac9-8de3-117406f1a173 admin admin] PATH_INFO: `/v3/projects/3ee3fdc9b9a0424b897a4f05d6b3569f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:20.774350 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36054921-151e-4ac9-8de3-117406f1a173 admin admin] RBAC: Authorizing `identity:get_project(project_id=3ee3fdc9b9a0424b897a4f05d6b3569f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:20.826521 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.common.rbac_enforcer.enforcer [None req-36054921-151e-4ac9-8de3-117406f1a173 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 14:17:20.826862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36054921-151e-4ac9-8de3-117406f1a173 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:20.831389 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 2/5] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:20 2021] GET /identity/v3/projects/3ee3fdc9b9a0424b897a4f05d6b3569f => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:22.972315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf0cdf-0432-45d6-a860-3e28321330f9 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:22.972809 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf0cdf-0432-45d6-a860-3e28321330f9 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:22.972901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf0cdf-0432-45d6-a860-3e28321330f9 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:22.978203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 4/6] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:22 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:22.984399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d052c26-253a-4ce9-b85b-851a66ce8474 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:22.984784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d052c26-253a-4ce9-b85b-851a66ce8474 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:22.984951 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d052c26-253a-4ce9-b85b-851a66ce8474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:23.003832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0d052c26-253a-4ce9-b85b-851a66ce8474 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:23.005330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0d052c26-253a-4ce9-b85b-851a66ce8474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:23.013416 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:23.036257 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf0cdf-0432-45d6-a860-3e28321330f9 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:23.049006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf0cdf-0432-45d6-a860-3e28321330f9 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:23.053171 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ed732-0b0b-42d6-9afd-65417f270447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:23.054554 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ed732-0b0b-42d6-9afd-65417f270447 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:23.054841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ed732-0b0b-42d6-9afd-65417f270447 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:23.055117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ed732-0b0b-42d6-9afd-65417f270447 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:23.062667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ed732-0b0b-42d6-9afd-65417f270447 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:23.064432 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ed732-0b0b-42d6-9afd-65417f270447 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:23.072902 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:23.078839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d052c26-253a-4ce9-b85b-851a66ce8474 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:23.088514 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d052c26-253a-4ce9-b85b-851a66ce8474 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:23.092853 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace36e-6b56-4316-b34f-54be292954c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:23.093710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace36e-6b56-4316-b34f-54be292954c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:23.094027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace36e-6b56-4316-b34f-54be292954c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:23.094305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace36e-6b56-4316-b34f-54be292954c6 admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:23.095682 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ace36e-6b56-4316-b34f-54be292954c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:23.097489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ace36e-6b56-4316-b34f-54be292954c6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:23.099070 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 4/9] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:23 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:25.281711 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55649f6c-0869-4fbd-9450-545b1a029b96 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:25.282302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55649f6c-0869-4fbd-9450-545b1a029b96 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:25.282302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55649f6c-0869-4fbd-9450-545b1a029b96 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:25.284005 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:17:25.289727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d66ff1-2d8a-4a3f-b1fe-1af418b58a29 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:25.290174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d66ff1-2d8a-4a3f-b1fe-1af418b58a29 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:25.290428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d66ff1-2d8a-4a3f-b1fe-1af418b58a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:25.308193 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-17d66ff1-2d8a-4a3f-b1fe-1af418b58a29 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:25.309349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-17d66ff1-2d8a-4a3f-b1fe-1af418b58a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:25.316764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:25.329739 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940075f-a8d7-440f-958a-c5cbfcdd6e4b None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:25.330124 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940075f-a8d7-440f-958a-c5cbfcdd6e4b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:25.330398 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940075f-a8d7-440f-958a-c5cbfcdd6e4b None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:25.332103 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 7/12] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:25.338027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa6c5d-302f-46a6-abfa-b67cee029f25 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:25.338322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa6c5d-302f-46a6-abfa-b67cee029f25 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:25.338597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa6c5d-302f-46a6-abfa-b67cee029f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:25.341902 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940075f-a8d7-440f-958a-c5cbfcdd6e4b None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:25.353416 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940075f-a8d7-440f-958a-c5cbfcdd6e4b None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:25.356262 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-19fa6c5d-302f-46a6-abfa-b67cee029f25 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:25.357451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-19fa6c5d-302f-46a6-abfa-b67cee029f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:25.357584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a19d8-02d3-4d0f-ac14-33077b07b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:25.358365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a19d8-02d3-4d0f-ac14-33077b07b5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:25.358645 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a19d8-02d3-4d0f-ac14-33077b07b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:25.358918 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a19d8-02d3-4d0f-ac14-33077b07b5d3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:25.364982 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:25.374440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a19d8-02d3-4d0f-ac14-33077b07b5d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:25.381201 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-861a19d8-02d3-4d0f-ac14-33077b07b5d3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:17:25.383026 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 8/14] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:17:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:17:25.389221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa6c5d-302f-46a6-abfa-b67cee029f25 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:25.389358 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a19d8-02d3-4d0f-ac14-33077b07b5d3 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:25.398333 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa6c5d-302f-46a6-abfa-b67cee029f25 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:25.398956 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a19d8-02d3-4d0f-ac14-33077b07b5d3 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:25.402701 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a67a3-1945-4dba-9ef8-962da108ddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:25.403331 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a67a3-1945-4dba-9ef8-962da108ddfc admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:25.403428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cf537-7015-49a1-a32a-36d5a3afec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:25.403613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a67a3-1945-4dba-9ef8-962da108ddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:25.403881 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a67a3-1945-4dba-9ef8-962da108ddfc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:25.404044 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cf537-7015-49a1-a32a-36d5a3afec11 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:25.404324 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cf537-7015-49a1-a32a-36d5a3afec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:25.404594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cf537-7015-49a1-a32a-36d5a3afec11 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:25.405335 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cf537-7015-49a1-a32a-36d5a3afec11 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:25.405637 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cf537-7015-49a1-a32a-36d5a3afec11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:25.407381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-782cf537-7015-49a1-a32a-36d5a3afec11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:25.407381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:17:25.407381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:17:25.408287 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cf537-7015-49a1-a32a-36d5a3afec11 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:25.411644 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a67a3-1945-4dba-9ef8-962da108ddfc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:25.413531 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a67a3-1945-4dba-9ef8-962da108ddfc admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:25.422161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 7/15] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:25.423035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 9/16] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:25.428148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a67a3-1945-4dba-9ef8-962da108ddfc admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:25.429077 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cf537-7015-49a1-a32a-36d5a3afec11 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:25.437177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a67a3-1945-4dba-9ef8-962da108ddfc admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:25.438355 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cf537-7015-49a1-a32a-36d5a3afec11 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:25.441509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d22249-02a5-417d-a4bc-406a01295734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:25.442303 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d22249-02a5-417d-a4bc-406a01295734 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:25.442579 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d22249-02a5-417d-a4bc-406a01295734 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:25.442765 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77694582-eb6f-4d47-a280-e135a7cb559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:25.442876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d22249-02a5-417d-a4bc-406a01295734 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:25.443598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77694582-eb6f-4d47-a280-e135a7cb559f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:25.443879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77694582-eb6f-4d47-a280-e135a7cb559f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:25.444115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d22249-02a5-417d-a4bc-406a01295734 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:25.444884 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77694582-eb6f-4d47-a280-e135a7cb559f admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:25.446267 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d22249-02a5-417d-a4bc-406a01295734 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:25.446636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77694582-eb6f-4d47-a280-e135a7cb559f admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:25.447780 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 8/17] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:17:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:25.448432 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77694582-eb6f-4d47-a280-e135a7cb559f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:25.450084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:25 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:25.456026 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d22249-02a5-417d-a4bc-406a01295734 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:25.466144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d22249-02a5-417d-a4bc-406a01295734 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:25.470661 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30189f7-8d8d-476c-815b-67a8f5f9c0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:25.471474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30189f7-8d8d-476c-815b-67a8f5f9c0bb admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:25.471754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30189f7-8d8d-476c-815b-67a8f5f9c0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:25.472026 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30189f7-8d8d-476c-815b-67a8f5f9c0bb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:25.473240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30189f7-8d8d-476c-815b-67a8f5f9c0bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:25.475045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30189f7-8d8d-476c-815b-67a8f5f9c0bb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:25.476768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:17:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:25.483359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77694582-eb6f-4d47-a280-e135a7cb559f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:25.494448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77694582-eb6f-4d47-a280-e135a7cb559f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:25.499049 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548f24e-ba88-48ea-be4d-39a7150bfc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:25.499780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548f24e-ba88-48ea-be4d-39a7150bfc4f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:25.500070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548f24e-ba88-48ea-be4d-39a7150bfc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:25.500349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548f24e-ba88-48ea-be4d-39a7150bfc4f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:25.501199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548f24e-ba88-48ea-be4d-39a7150bfc4f admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.domain.id=default, user.id=a0f8f7fa57374efdb2df20708faea2ef) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:25.501512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548f24e-ba88-48ea-be4d-39a7150bfc4f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:25.502603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-8548f24e-ba88-48ea-be4d-39a7150bfc4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:25.502603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:17:25.502603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:17:25.503814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548f24e-ba88-48ea-be4d-39a7150bfc4f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:25.514271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1344 bytes} [Sun Aug 29 14:17:25 2021] GET /identity/v3/role_assignments?user.id=a0f8f7fa57374efdb2df20708faea2ef&scope.domain.id=default&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:28.073206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea705e6-1015-4d94-8873-67e48b4bba0e None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.074432 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea705e6-1015-4d94-8873-67e48b4bba0e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.075011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea705e6-1015-4d94-8873-67e48b4bba0e None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.077816 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:28 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:28.084840 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1a5b3-ec3b-4e73-a3d6-479a8c5e3851 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.085765 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1a5b3-ec3b-4e73-a3d6-479a8c5e3851 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.086273 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1a5b3-ec3b-4e73-a3d6-479a8c5e3851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.125608 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG passlib.handlers.bcrypt [None req-19c1a5b3-ec3b-4e73-a3d6-479a8c5e3851 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73674) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 14:17:28.126424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG passlib.handlers.bcrypt [None req-19c1a5b3-ec3b-4e73-a3d6-479a8c5e3851 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73674) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 14:17:28.173667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-19c1a5b3-ec3b-4e73-a3d6-479a8c5e3851 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:28.175717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-19c1a5b3-ec3b-4e73-a3d6-479a8c5e3851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:28.217626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 12/22] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:28.243012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea705e6-1015-4d94-8873-67e48b4bba0e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:28.250447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249d1f0-0d05-4bb3-bb20-cfc1d6723a82 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.251937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249d1f0-0d05-4bb3-bb20-cfc1d6723a82 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.252425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249d1f0-0d05-4bb3-bb20-cfc1d6723a82 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.258873 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea705e6-1015-4d94-8873-67e48b4bba0e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:28.259796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 13/23] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:28 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:28.261535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81010aae-7bbd-402e-a06c-08e360b782d1 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.262697 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81010aae-7bbd-402e-a06c-08e360b782d1 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.263519 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81010aae-7bbd-402e-a06c-08e360b782d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.268577 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16493e79-4c30-4586-8a25-61d9851cdf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:28.270151 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16493e79-4c30-4586-8a25-61d9851cdf4d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.271681 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16493e79-4c30-4586-8a25-61d9851cdf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.272184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16493e79-4c30-4586-8a25-61d9851cdf4d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.301854 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-81010aae-7bbd-402e-a06c-08e360b782d1 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:28.304286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-81010aae-7bbd-402e-a06c-08e360b782d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:28.305104 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16493e79-4c30-4586-8a25-61d9851cdf4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:28.312199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-16493e79-4c30-4586-8a25-61d9851cdf4d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:17:28.319955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 11/24] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:17:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:28.322336 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 14/25] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:28.323392 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16493e79-4c30-4586-8a25-61d9851cdf4d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:28.337900 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16493e79-4c30-4586-8a25-61d9851cdf4d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:28.342737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a835d-b3d5-4aaf-ab62-7b859b5bb5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:28.343638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a835d-b3d5-4aaf-ab62-7b859b5bb5ca admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.344106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a835d-b3d5-4aaf-ab62-7b859b5bb5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.344578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a835d-b3d5-4aaf-ab62-7b859b5bb5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.345525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a835d-b3d5-4aaf-ab62-7b859b5bb5ca admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:28.346061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a835d-b3d5-4aaf-ab62-7b859b5bb5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:28.347985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-5d9a835d-b3d5-4aaf-ab62-7b859b5bb5ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:28.347985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:17:28.347985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:17:28.349198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a835d-b3d5-4aaf-ab62-7b859b5bb5ca admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:28.366707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81010aae-7bbd-402e-a06c-08e360b782d1 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:28.367941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 12/26] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:28.379041 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a835d-b3d5-4aaf-ab62-7b859b5bb5ca admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:28.383420 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81010aae-7bbd-402e-a06c-08e360b782d1 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:28.388511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794e57b-68c1-4e19-b074-6f001fc8e736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:28.389568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794e57b-68c1-4e19-b074-6f001fc8e736 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.390097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794e57b-68c1-4e19-b074-6f001fc8e736 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.390556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794e57b-68c1-4e19-b074-6f001fc8e736 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.398257 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a835d-b3d5-4aaf-ab62-7b859b5bb5ca admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:28.420232 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491eaa46-31b9-44d1-b7fb-8ed11242e990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:28.421160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491eaa46-31b9-44d1-b7fb-8ed11242e990 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.421442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491eaa46-31b9-44d1-b7fb-8ed11242e990 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.421716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491eaa46-31b9-44d1-b7fb-8ed11242e990 admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.424404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491eaa46-31b9-44d1-b7fb-8ed11242e990 admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:28.426348 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491eaa46-31b9-44d1-b7fb-8ed11242e990 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:28.428963 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 13/27] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:28 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:28.438994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491eaa46-31b9-44d1-b7fb-8ed11242e990 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:28.446520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794e57b-68c1-4e19-b074-6f001fc8e736 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:28.448478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794e57b-68c1-4e19-b074-6f001fc8e736 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:28.464862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491eaa46-31b9-44d1-b7fb-8ed11242e990 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:28.472324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a89518-d6fd-4e70-bdd5-8099953e4de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:28.473070 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a89518-d6fd-4e70-bdd5-8099953e4de6 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.473356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a89518-d6fd-4e70-bdd5-8099953e4de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.473631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a89518-d6fd-4e70-bdd5-8099953e4de6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.482351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-9794e57b-68c1-4e19-b074-6f001fc8e736 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:17:28.484650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a89518-d6fd-4e70-bdd5-8099953e4de6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:28.486487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a89518-d6fd-4e70-bdd5-8099953e4de6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:28.488581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 14/28] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:17:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:28.488872 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 15/29] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:17:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:17:28.494663 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a89518-d6fd-4e70-bdd5-8099953e4de6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:28.496580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794e57b-68c1-4e19-b074-6f001fc8e736 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:28.515481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a89518-d6fd-4e70-bdd5-8099953e4de6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:28.522838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794e57b-68c1-4e19-b074-6f001fc8e736 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:28.525194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225da36-a3ba-4164-a509-358f9d5f048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:28.526276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225da36-a3ba-4164-a509-358f9d5f048c admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.526689 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225da36-a3ba-4164-a509-358f9d5f048c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.527101 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225da36-a3ba-4164-a509-358f9d5f048c admin admin] PATH_INFO: `/v3/domains/default/users/a0f8f7fa57374efdb2df20708faea2ef/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.529278 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225da36-a3ba-4164-a509-358f9d5f048c admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a0f8f7fa57374efdb2df20708faea2ef, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:28.530565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-c225da36-a3ba-4164-a509-358f9d5f048c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:28.530565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:17:28.530565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:17:28.532974 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225da36-a3ba-4164-a509-358f9d5f048c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:28.537278 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b131785-9d20-4dfb-879c-9a6083d57d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:28.538669 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b131785-9d20-4dfb-879c-9a6083d57d3e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.538979 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b131785-9d20-4dfb-879c-9a6083d57d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.539256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b131785-9d20-4dfb-879c-9a6083d57d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.540490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b131785-9d20-4dfb-879c-9a6083d57d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:28.540802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b131785-9d20-4dfb-879c-9a6083d57d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:28.545886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-4b131785-9d20-4dfb-879c-9a6083d57d3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:28.545886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:17:28.545886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:17:28.545886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b131785-9d20-4dfb-879c-9a6083d57d3e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:28.566006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 16/30] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:17:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:28.567416 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336810f-fba1-4ff3-99c6-17b1a57473f3 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.567706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336810f-fba1-4ff3-99c6-17b1a57473f3 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.567983 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336810f-fba1-4ff3-99c6-17b1a57473f3 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.570373 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 17/31] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:28.576022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336810f-fba1-4ff3-99c6-17b1a57473f3 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:28.590957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336810f-fba1-4ff3-99c6-17b1a57473f3 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:28.595687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc8626-f872-4121-a48c-5e9c199bed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:28.596340 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8626-f872-4121-a48c-5e9c199bed36 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.596624 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8626-f872-4121-a48c-5e9c199bed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.596901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8626-f872-4121-a48c-5e9c199bed36 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.597874 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc8626-f872-4121-a48c-5e9c199bed36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:28.599062 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-ccfc8626-f872-4121-a48c-5e9c199bed36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:28.599062 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:17:28.599062 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:17:28.600886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc8626-f872-4121-a48c-5e9c199bed36 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:28.863865 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 15/32] 10.222.0.16 () {58 vars in 1383 bytes} [Sun Aug 29 14:17:28 2021] PUT /identity/v3/domains/default/users/a0f8f7fa57374efdb2df20708faea2ef/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:17:28.866090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17004562-6640-4fb6-bcc9-11d6b97fd818 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.866597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17004562-6640-4fb6-bcc9-11d6b97fd818 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.867071 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17004562-6640-4fb6-bcc9-11d6b97fd818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.902148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-17004562-6640-4fb6-bcc9-11d6b97fd818 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:28.904049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-17004562-6640-4fb6-bcc9-11d6b97fd818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:28.965033 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 18/33] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:17:28 2021] POST /identity/v3/projects => generated 301 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:17:28.967050 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595aa3d9-16a6-4e4f-9eb5-5c3e91dd8cee None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.967514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595aa3d9-16a6-4e4f-9eb5-5c3e91dd8cee None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.967988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595aa3d9-16a6-4e4f-9eb5-5c3e91dd8cee None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:28.970415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 19/34] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:28.977422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797e0c-35a8-4a34-9aee-1ddbe24cd83c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:28.977883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797e0c-35a8-4a34-9aee-1ddbe24cd83c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:28.978254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797e0c-35a8-4a34-9aee-1ddbe24cd83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:29.023217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-ce797e0c-35a8-4a34-9aee-1ddbe24cd83c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:29.025153 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ce797e0c-35a8-4a34-9aee-1ddbe24cd83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:29.031408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 16/35] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:29.077215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17004562-6640-4fb6-bcc9-11d6b97fd818 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:29.096709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17004562-6640-4fb6-bcc9-11d6b97fd818 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:29.141545 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 20/36] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:29.211228 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce797e0c-35a8-4a34-9aee-1ddbe24cd83c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:29.218124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa128cb-7f30-44a8-8107-3c4df4d0c3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:29.219066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa128cb-7f30-44a8-8107-3c4df4d0c3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:29.219503 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa128cb-7f30-44a8-8107-3c4df4d0c3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:29.219901 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa128cb-7f30-44a8-8107-3c4df4d0c3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:29.220805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa128cb-7f30-44a8-8107-3c4df4d0c3d0 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:29.222320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-0fa128cb-7f30-44a8-8107-3c4df4d0c3d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:29.222320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:17:29.222320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:17:29.223548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa128cb-7f30-44a8-8107-3c4df4d0c3d0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:29.225564 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce797e0c-35a8-4a34-9aee-1ddbe24cd83c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:29.234065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef68d6-b2ec-461e-b348-4c0e11e7447a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:29.235175 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef68d6-b2ec-461e-b348-4c0e11e7447a admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:29.235671 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef68d6-b2ec-461e-b348-4c0e11e7447a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:29.236200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef68d6-b2ec-461e-b348-4c0e11e7447a admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:29.237242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef68d6-b2ec-461e-b348-4c0e11e7447a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:29.238673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-78ef68d6-b2ec-461e-b348-4c0e11e7447a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:29.238673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:17:29.238673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:17:29.240011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef68d6-b2ec-461e-b348-4c0e11e7447a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:29.305473 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 17/37] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:17:29 2021] POST /identity/v3/roles => generated 225 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:17:29.308994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1a205-d8ce-4220-b112-dfdf36e7001a None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:29.309264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1a205-d8ce-4220-b112-dfdf36e7001a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:29.309542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1a205-d8ce-4220-b112-dfdf36e7001a None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:29.311601 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 18/38] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:17:29.318188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5366e-835d-417b-b540-78e116b93074 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:29.319535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5366e-835d-417b-b540-78e116b93074 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:29.320280 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5366e-835d-417b-b540-78e116b93074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:29.334257 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 21/39] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:17:29 2021] POST /identity/v3/roles => generated 219 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:17:29.352475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-48c5366e-835d-417b-b540-78e116b93074 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:29.354153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-48c5366e-835d-417b-b540-78e116b93074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:29.363358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 19/40] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:29.400814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef68d6-b2ec-461e-b348-4c0e11e7447a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:29.411967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef68d6-b2ec-461e-b348-4c0e11e7447a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:29.421537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f332d-f8c5-43c6-b7ea-ef53858cb21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:29.422866 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f332d-f8c5-43c6-b7ea-ef53858cb21d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:29.423415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f332d-f8c5-43c6-b7ea-ef53858cb21d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:29.423954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f332d-f8c5-43c6-b7ea-ef53858cb21d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:29.425462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f332d-f8c5-43c6-b7ea-ef53858cb21d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:29.427553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f332d-f8c5-43c6-b7ea-ef53858cb21d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:29.431462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 22/41] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:17:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:29.437801 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5366e-835d-417b-b540-78e116b93074 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:29.451664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5366e-835d-417b-b540-78e116b93074 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:29.459246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b7ce9-c406-48b6-90b8-23304238b54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:29.459964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b7ce9-c406-48b6-90b8-23304238b54a admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:29.460252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b7ce9-c406-48b6-90b8-23304238b54a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:29.460527 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b7ce9-c406-48b6-90b8-23304238b54a admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:29.461270 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b7ce9-c406-48b6-90b8-23304238b54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:29.462375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-e32b7ce9-c406-48b6-90b8-23304238b54a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:29.462375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:17:29.462375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:17:29.463586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b7ce9-c406-48b6-90b8-23304238b54a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:29.586839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 20/42] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:17:29 2021] POST /identity/v3/projects => generated 312 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:17:29.763521 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0c635-4178-487c-becd-4fdf91c658ea None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:29.763749 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0c635-4178-487c-becd-4fdf91c658ea None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:29.764104 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0c635-4178-487c-becd-4fdf91c658ea None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:29.766058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 23/43] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:29.771892 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501028a-8fa8-4e36-b546-912e974df4c1 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:29.772348 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501028a-8fa8-4e36-b546-912e974df4c1 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:29.772785 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501028a-8fa8-4e36-b546-912e974df4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:29.791436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-6501028a-8fa8-4e36-b546-912e974df4c1 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:29.792913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-6501028a-8fa8-4e36-b546-912e974df4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:29.850008 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 21/44] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:29.874375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0c635-4178-487c-becd-4fdf91c658ea None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:29.887603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0c635-4178-487c-becd-4fdf91c658ea None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:29.891937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec380e-083e-43d1-90b0-2087e0dbfa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:29.892596 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec380e-083e-43d1-90b0-2087e0dbfa44 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:29.892879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec380e-083e-43d1-90b0-2087e0dbfa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:29.893169 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec380e-083e-43d1-90b0-2087e0dbfa44 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:29.893952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec380e-083e-43d1-90b0-2087e0dbfa44 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:29.895553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec380e-083e-43d1-90b0-2087e0dbfa44 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:29.972596 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 24/45] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:17:29 2021] POST /identity/v3/roles => generated 223 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:17:31.232666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3b1d-853f-4aed-a5da-2ab73488e060 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:31.233141 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3b1d-853f-4aed-a5da-2ab73488e060 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:31.233230 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3b1d-853f-4aed-a5da-2ab73488e060 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:31.235086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 22/46] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:31.240913 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb4579-708d-415f-a8e8-d9a9f204f07e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:31.241316 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb4579-708d-415f-a8e8-d9a9f204f07e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:31.241469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb4579-708d-415f-a8e8-d9a9f204f07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:31.260112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-50fb4579-708d-415f-a8e8-d9a9f204f07e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:31.261307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-50fb4579-708d-415f-a8e8-d9a9f204f07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:31.268975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 25/47] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:31.293564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a3b1d-853f-4aed-a5da-2ab73488e060 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:31.306465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a3b1d-853f-4aed-a5da-2ab73488e060 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:31.310676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9025182-ae24-4052-ad82-680db3cdf9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:31.311455 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9025182-ae24-4052-ad82-680db3cdf9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:31.311737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9025182-ae24-4052-ad82-680db3cdf9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:31.312010 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9025182-ae24-4052-ad82-680db3cdf9e1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:31.322907 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9025182-ae24-4052-ad82-680db3cdf9e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:31.329626 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-a9025182-ae24-4052-ad82-680db3cdf9e1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:17:31.330832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 23/48] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:17:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:31.337513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb4579-708d-415f-a8e8-d9a9f204f07e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:31.346487 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb4579-708d-415f-a8e8-d9a9f204f07e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:31.351549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee481899-1323-416d-aca8-8fead4a177a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:31.352209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee481899-1323-416d-aca8-8fead4a177a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:31.352493 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee481899-1323-416d-aca8-8fead4a177a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:31.352773 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee481899-1323-416d-aca8-8fead4a177a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:31.353530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee481899-1323-416d-aca8-8fead4a177a2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:31.353841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee481899-1323-416d-aca8-8fead4a177a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:31.355503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee481899-1323-416d-aca8-8fead4a177a2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:31.363623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 26/49] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:31.369696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9025182-ae24-4052-ad82-680db3cdf9e1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:31.380848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9025182-ae24-4052-ad82-680db3cdf9e1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:31.385489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb625cb-0501-42db-b714-ce6d7eeee1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:31.386382 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb625cb-0501-42db-b714-ce6d7eeee1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:31.386926 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb625cb-0501-42db-b714-ce6d7eeee1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:31.387203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb625cb-0501-42db-b714-ce6d7eeee1d5 admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:31.388401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb625cb-0501-42db-b714-ce6d7eeee1d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:31.390246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb625cb-0501-42db-b714-ce6d7eeee1d5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:31.391837 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 24/50] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:31 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:31.398578 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee481899-1323-416d-aca8-8fead4a177a2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:31.408334 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee481899-1323-416d-aca8-8fead4a177a2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:31.413354 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b58ae-a295-41c1-8d35-698b046c4526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:31.414190 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b58ae-a295-41c1-8d35-698b046c4526 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:31.414473 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b58ae-a295-41c1-8d35-698b046c4526 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:31.414749 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b58ae-a295-41c1-8d35-698b046c4526 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:31.415927 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b58ae-a295-41c1-8d35-698b046c4526 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:31.417610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b58ae-a295-41c1-8d35-698b046c4526 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:31.419219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 27/51] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:17:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:31.425296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb625cb-0501-42db-b714-ce6d7eeee1d5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:31.434891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb625cb-0501-42db-b714-ce6d7eeee1d5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:31.439232 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b458d71-e834-488b-8e94-5c78f93356e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:31.439880 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b458d71-e834-488b-8e94-5c78f93356e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:31.440164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b458d71-e834-488b-8e94-5c78f93356e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:31.440440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b458d71-e834-488b-8e94-5c78f93356e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:31.441265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b458d71-e834-488b-8e94-5c78f93356e3 admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.domain.id=default, user.id=a0f8f7fa57374efdb2df20708faea2ef) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:31.441576 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b458d71-e834-488b-8e94-5c78f93356e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:31.442613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-4b458d71-e834-488b-8e94-5c78f93356e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:31.442613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:17:31.442613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:17:31.443883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b458d71-e834-488b-8e94-5c78f93356e3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:31.451133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 25/52] 10.222.0.16 () {56 vars in 1344 bytes} [Sun Aug 29 14:17:31 2021] GET /identity/v3/role_assignments?user.id=a0f8f7fa57374efdb2df20708faea2ef&scope.domain.id=default&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:31.758511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1aca6-75b7-44b8-bcf2-23d1f974a146 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:31.758801 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1aca6-75b7-44b8-bcf2-23d1f974a146 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:31.759084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1aca6-75b7-44b8-bcf2-23d1f974a146 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:31.760867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 28/53] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:31.766716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895147e7-2f2d-4b09-a113-3e2c37402f07 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:31.767012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895147e7-2f2d-4b09-a113-3e2c37402f07 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:31.767296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895147e7-2f2d-4b09-a113-3e2c37402f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:31.785009 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-895147e7-2f2d-4b09-a113-3e2c37402f07 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:31.786218 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-895147e7-2f2d-4b09-a113-3e2c37402f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:31.794096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 26/54] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:31.818114 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1aca6-75b7-44b8-bcf2-23d1f974a146 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:31.830532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1aca6-75b7-44b8-bcf2-23d1f974a146 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:31.835370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ca6a1-6119-4d19-8fe4-131747641c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:31.836142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ca6a1-6119-4d19-8fe4-131747641c00 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:31.836427 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ca6a1-6119-4d19-8fe4-131747641c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:31.836704 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ca6a1-6119-4d19-8fe4-131747641c00 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:31.837880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ca6a1-6119-4d19-8fe4-131747641c00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:31.839585 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ca6a1-6119-4d19-8fe4-131747641c00 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:31.841135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 29/55] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:17:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:31.846650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895147e7-2f2d-4b09-a113-3e2c37402f07 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:31.855281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895147e7-2f2d-4b09-a113-3e2c37402f07 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:31.859675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70e7e6-f4dd-45d9-bfb9-db653b764160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:31.860314 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70e7e6-f4dd-45d9-bfb9-db653b764160 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:31.860599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70e7e6-f4dd-45d9-bfb9-db653b764160 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:31.860874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70e7e6-f4dd-45d9-bfb9-db653b764160 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:31.861575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70e7e6-f4dd-45d9-bfb9-db653b764160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:31.863517 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70e7e6-f4dd-45d9-bfb9-db653b764160 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:31.996188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 27/56] 10.222.0.16 () {60 vars in 1162 bytes} [Sun Aug 29 14:17:31 2021] POST /identity/v3/projects => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:17:34.128995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f3cee-2d9a-4d84-a11e-75b237dd7c5a None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:34.129500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f3cee-2d9a-4d84-a11e-75b237dd7c5a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:34.129582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f3cee-2d9a-4d84-a11e-75b237dd7c5a None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:34.131482 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 30/57] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:34.137426 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eecaf-aefd-427a-89e4-7a0c04885a69 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:34.137812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eecaf-aefd-427a-89e4-7a0c04885a69 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:34.138025 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eecaf-aefd-427a-89e4-7a0c04885a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:34.155325 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-566eecaf-aefd-427a-89e4-7a0c04885a69 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:34.156499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-566eecaf-aefd-427a-89e4-7a0c04885a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:34.210860 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 28/58] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:34.236162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f3cee-2d9a-4d84-a11e-75b237dd7c5a None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:34.248528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f3cee-2d9a-4d84-a11e-75b237dd7c5a None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:34.252761 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675f502-436b-4b96-bc72-2eebca34fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:34.253534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675f502-436b-4b96-bc72-2eebca34fbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:34.253817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675f502-436b-4b96-bc72-2eebca34fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:34.254120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675f502-436b-4b96-bc72-2eebca34fbc5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:34.255274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675f502-436b-4b96-bc72-2eebca34fbc5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:34.256972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675f502-436b-4b96-bc72-2eebca34fbc5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:34.258548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 31/59] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:17:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:34.264430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eecaf-aefd-427a-89e4-7a0c04885a69 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:34.273071 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eecaf-aefd-427a-89e4-7a0c04885a69 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:34.277456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673cc66-997f-484d-a3ff-d686879c342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:34.278138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673cc66-997f-484d-a3ff-d686879c342c admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:34.278421 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673cc66-997f-484d-a3ff-d686879c342c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:34.278725 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673cc66-997f-484d-a3ff-d686879c342c admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:34.279502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673cc66-997f-484d-a3ff-d686879c342c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:34.280503 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-e673cc66-997f-484d-a3ff-d686879c342c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:34.280503 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:17:34.280503 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:17:34.281735 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673cc66-997f-484d-a3ff-d686879c342c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:34.435565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 29/60] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:17:34 2021] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:17:37.712274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48454342-92d9-4e4b-af53-92f73e27e425 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:37.713163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48454342-92d9-4e4b-af53-92f73e27e425 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:37.713580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48454342-92d9-4e4b-af53-92f73e27e425 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:37.715772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 32/61] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:37.722256 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eb4b5-8c04-478e-8ece-07d590b92f2c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:37.723053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eb4b5-8c04-478e-8ece-07d590b92f2c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:37.723505 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eb4b5-8c04-478e-8ece-07d590b92f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:37.751533 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-a93eb4b5-8c04-478e-8ece-07d590b92f2c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:37.752970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a93eb4b5-8c04-478e-8ece-07d590b92f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:37.765915 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 30/62] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:37.801633 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48454342-92d9-4e4b-af53-92f73e27e425 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:37.820060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48454342-92d9-4e4b-af53-92f73e27e425 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:37.824982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6164d6b-82b6-4f0e-a0d0-636d714b47eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:37.825969 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6164d6b-82b6-4f0e-a0d0-636d714b47eb admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:37.826396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6164d6b-82b6-4f0e-a0d0-636d714b47eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:37.826816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6164d6b-82b6-4f0e-a0d0-636d714b47eb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:37.842998 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6164d6b-82b6-4f0e-a0d0-636d714b47eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:37.850160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-b6164d6b-82b6-4f0e-a0d0-636d714b47eb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:37.853699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 33/63] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:37.859750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eb4b5-8c04-478e-8ece-07d590b92f2c None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:37.870594 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eb4b5-8c04-478e-8ece-07d590b92f2c None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:37.880906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9e1c9-0821-4e96-a592-5babe8ab3492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:37.882080 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9e1c9-0821-4e96-a592-5babe8ab3492 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:37.882982 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9e1c9-0821-4e96-a592-5babe8ab3492 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:37.883411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9e1c9-0821-4e96-a592-5babe8ab3492 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:37.884341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9e1c9-0821-4e96-a592-5babe8ab3492 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:37.884809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9e1c9-0821-4e96-a592-5babe8ab3492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:37.886927 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9e1c9-0821-4e96-a592-5babe8ab3492 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:37.902992 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 31/64] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:37.908785 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6164d6b-82b6-4f0e-a0d0-636d714b47eb admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:37.920193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6164d6b-82b6-4f0e-a0d0-636d714b47eb admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:37.931450 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6002-25d9-4562-8587-0b49fd576afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:37.932532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6002-25d9-4562-8587-0b49fd576afa admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:37.932962 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6002-25d9-4562-8587-0b49fd576afa admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:37.933381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6002-25d9-4562-8587-0b49fd576afa admin admin] PATH_INFO: `/v3/users/7b3af60575154adca1fde17caac19ae8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:37.950825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6002-25d9-4562-8587-0b49fd576afa admin admin] RBAC: Authorizing `identity:get_user(user_id=7b3af60575154adca1fde17caac19ae8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:37.953231 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6002-25d9-4562-8587-0b49fd576afa admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:37.955407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 34/65] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:37 2021] GET /identity/v3/users/7b3af60575154adca1fde17caac19ae8 => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:37.961821 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9e1c9-0821-4e96-a592-5babe8ab3492 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:37.976011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9e1c9-0821-4e96-a592-5babe8ab3492 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:37.985135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032296fe-b97b-4704-8990-8f28a1e1ec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:37.985813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032296fe-b97b-4704-8990-8f28a1e1ec92 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:37.986127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032296fe-b97b-4704-8990-8f28a1e1ec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:37.986410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032296fe-b97b-4704-8990-8f28a1e1ec92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.000890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032296fe-b97b-4704-8990-8f28a1e1ec92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.002772 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032296fe-b97b-4704-8990-8f28a1e1ec92 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.014608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 32/66] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:38.021001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6002-25d9-4562-8587-0b49fd576afa admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.036688 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6002-25d9-4562-8587-0b49fd576afa admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.042099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520311-4832-420e-88e4-8db6260a32d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.043152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520311-4832-420e-88e4-8db6260a32d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.043442 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520311-4832-420e-88e4-8db6260a32d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.043722 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520311-4832-420e-88e4-8db6260a32d1 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.044934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7520311-4832-420e-88e4-8db6260a32d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.047056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7520311-4832-420e-88e4-8db6260a32d1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.048792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 35/67] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.056033 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032296fe-b97b-4704-8990-8f28a1e1ec92 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.065283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032296fe-b97b-4704-8990-8f28a1e1ec92 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.073532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a80b8a-14a2-4fc1-939a-47af1d4b95c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.074246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80b8a-14a2-4fc1-939a-47af1d4b95c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.074535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80b8a-14a2-4fc1-939a-47af1d4b95c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.074819 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80b8a-14a2-4fc1-939a-47af1d4b95c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.075679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a80b8a-14a2-4fc1-939a-47af1d4b95c8 admin admin] RBAC: Adding query filter params (role.id=8f6eaa48bff44ea8822a222e38de2feb, scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8, user.id=7b3af60575154adca1fde17caac19ae8) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:38.076067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a80b8a-14a2-4fc1-939a-47af1d4b95c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.078161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a80b8a-14a2-4fc1-939a-47af1d4b95c8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.090800 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 33/68] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/role_assignments?user.id=7b3af60575154adca1fde17caac19ae8&scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8&role.id=8f6eaa48bff44ea8822a222e38de2feb => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.146938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480be1a1-0b39-4d9b-a2ca-e11ae528233a None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.148157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480be1a1-0b39-4d9b-a2ca-e11ae528233a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.148715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480be1a1-0b39-4d9b-a2ca-e11ae528233a None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.151054 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 36/69] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:38.158106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7c170-4f81-4cb4-a8c8-4a6268860441 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.158422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7c170-4f81-4cb4-a8c8-4a6268860441 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.158674 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7c170-4f81-4cb4-a8c8-4a6268860441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.166050 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd7c6a-8af2-4324-856b-a114a73a9e89 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.166354 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd7c6a-8af2-4324-856b-a114a73a9e89 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.166608 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd7c6a-8af2-4324-856b-a114a73a9e89 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.168654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 37/70] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:38.175191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cdf22-c611-4767-98bd-88fe54a769be None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.175478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cdf22-c611-4767-98bd-88fe54a769be None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.175761 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cdf22-c611-4767-98bd-88fe54a769be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.186238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-5ad7c170-4f81-4cb4-a8c8-4a6268860441 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:38.187463 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5ad7c170-4f81-4cb4-a8c8-4a6268860441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:38.204461 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-be7cdf22-c611-4767-98bd-88fe54a769be None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:38.205679 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-be7cdf22-c611-4767-98bd-88fe54a769be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:38.212515 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 34/71] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:38.228266 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 38/72] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:38.229733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9e558-bba8-43d1-83da-f8545d6e791c None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.230049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9e558-bba8-43d1-83da-f8545d6e791c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.230331 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9e558-bba8-43d1-83da-f8545d6e791c None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.232264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 35/73] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:38.238689 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9e558-bba8-43d1-83da-f8545d6e791c None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.242878 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b676de-aac4-4e6f-8e9c-de85a310e7d6 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.243167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b676de-aac4-4e6f-8e9c-de85a310e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.243448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b676de-aac4-4e6f-8e9c-de85a310e7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.262244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9e558-bba8-43d1-83da-f8545d6e791c None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.267079 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc3b1a-3811-4ab0-85cf-fb35f51ebae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.267914 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc3b1a-3811-4ab0-85cf-fb35f51ebae0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.268200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc3b1a-3811-4ab0-85cf-fb35f51ebae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.268480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc3b1a-3811-4ab0-85cf-fb35f51ebae0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.274030 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-a3b676de-aac4-4e6f-8e9c-de85a310e7d6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:38.275337 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a3b676de-aac4-4e6f-8e9c-de85a310e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:38.281507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc3b1a-3811-4ab0-85cf-fb35f51ebae0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:38.284000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 39/74] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:38.284995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b676de-aac4-4e6f-8e9c-de85a310e7d6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.289592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-e1fc3b1a-3811-4ab0-85cf-fb35f51ebae0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:17:38.291206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 36/75] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:17:38.301474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b676de-aac4-4e6f-8e9c-de85a310e7d6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.304245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc3b1a-3811-4ab0-85cf-fb35f51ebae0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.307788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcdb62-2d6f-4db1-9d08-4a1edefca8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.308907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcdb62-2d6f-4db1-9d08-4a1edefca8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.309244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcdb62-2d6f-4db1-9d08-4a1edefca8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.309525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcdb62-2d6f-4db1-9d08-4a1edefca8c9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.317318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc3b1a-3811-4ab0-85cf-fb35f51ebae0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.321843 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcdb62-2d6f-4db1-9d08-4a1edefca8c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:38.323500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92d45-d042-4e2d-a0aa-ce822cded140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.324444 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92d45-d042-4e2d-a0aa-ce822cded140 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.325014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92d45-d042-4e2d-a0aa-ce822cded140 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.325488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92d45-d042-4e2d-a0aa-ce822cded140 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.326481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e92d45-d042-4e2d-a0aa-ce822cded140 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:38.327007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e92d45-d042-4e2d-a0aa-ce822cded140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.328868 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e92d45-d042-4e2d-a0aa-ce822cded140 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.328978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-84bcdb62-2d6f-4db1-9d08-4a1edefca8c9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:38.330192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 40/76] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:38.335229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcdb62-2d6f-4db1-9d08-4a1edefca8c9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.343402 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcdb62-2d6f-4db1-9d08-4a1edefca8c9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.345389 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 37/77] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:38.346646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92d45-d042-4e2d-a0aa-ce822cded140 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.348058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47108b49-187a-4ff5-a799-16fb2711dd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.348860 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47108b49-187a-4ff5-a799-16fb2711dd32 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.349140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47108b49-187a-4ff5-a799-16fb2711dd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.349412 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47108b49-187a-4ff5-a799-16fb2711dd32 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.358780 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92d45-d042-4e2d-a0aa-ce822cded140 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.361585 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47108b49-187a-4ff5-a799-16fb2711dd32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:38.363341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82615cb-4576-4475-91b1-ae7bdf321a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.364010 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82615cb-4576-4475-91b1-ae7bdf321a4e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.364290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82615cb-4576-4475-91b1-ae7bdf321a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.364580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82615cb-4576-4475-91b1-ae7bdf321a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.365314 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82615cb-4576-4475-91b1-ae7bdf321a4e admin admin] RBAC: Adding query filter params (name=member) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:38.365622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82615cb-4576-4475-91b1-ae7bdf321a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.367684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82615cb-4576-4475-91b1-ae7bdf321a4e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.368835 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-47108b49-187a-4ff5-a799-16fb2711dd32 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:17:38.370058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 41/78] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:38.372285 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47108b49-187a-4ff5-a799-16fb2711dd32 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.379889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 38/79] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.381188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83bee8-1486-4fc5-901a-78ba6b5ccbad None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.381481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83bee8-1486-4fc5-901a-78ba6b5ccbad None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.381965 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83bee8-1486-4fc5-901a-78ba6b5ccbad None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.383827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 39/80] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:38.384391 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83bee8-1486-4fc5-901a-78ba6b5ccbad None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.390932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47108b49-187a-4ff5-a799-16fb2711dd32 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.395452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b558d-f692-4d32-aaa7-65e2a4a56641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.396312 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b558d-f692-4d32-aaa7-65e2a4a56641 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.396600 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b558d-f692-4d32-aaa7-65e2a4a56641 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.396770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83bee8-1486-4fc5-901a-78ba6b5ccbad None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.396921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b558d-f692-4d32-aaa7-65e2a4a56641 admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.398730 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b558d-f692-4d32-aaa7-65e2a4a56641 admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.400843 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b558d-f692-4d32-aaa7-65e2a4a56641 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.401578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8bbc0-7222-4c78-9dc6-718e4ff8cf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.402250 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8bbc0-7222-4c78-9dc6-718e4ff8cf51 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.402540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8bbc0-7222-4c78-9dc6-718e4ff8cf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.402748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 42/81] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.402834 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8bbc0-7222-4c78-9dc6-718e4ff8cf51 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.403549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8bbc0-7222-4c78-9dc6-718e4ff8cf51 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:38.403857 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8bbc0-7222-4c78-9dc6-718e4ff8cf51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.403952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5943400-9e2e-476d-b4f0-ed8d8b35facf None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.404157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5943400-9e2e-476d-b4f0-ed8d8b35facf None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.404434 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5943400-9e2e-476d-b4f0-ed8d8b35facf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.405445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8bbc0-7222-4c78-9dc6-718e4ff8cf51 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.414526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 40/82] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.415313 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8bbc0-7222-4c78-9dc6-718e4ff8cf51 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.424427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8bbc0-7222-4c78-9dc6-718e4ff8cf51 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.428809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93d649-85fc-44ae-90f3-ae6c80203beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.429671 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93d649-85fc-44ae-90f3-ae6c80203beb admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.429979 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93d649-85fc-44ae-90f3-ae6c80203beb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.430260 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93d649-85fc-44ae-90f3-ae6c80203beb admin admin] PATH_INFO: `/v3/users/7b3af60575154adca1fde17caac19ae8` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.431449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93d649-85fc-44ae-90f3-ae6c80203beb admin admin] RBAC: Authorizing `identity:get_user(user_id=7b3af60575154adca1fde17caac19ae8)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.432567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c5943400-9e2e-476d-b4f0-ed8d8b35facf None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:38.433610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93d649-85fc-44ae-90f3-ae6c80203beb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.433760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c5943400-9e2e-476d-b4f0-ed8d8b35facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:38.435403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 41/83] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/users/7b3af60575154adca1fde17caac19ae8 => generated 275 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.436002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93d649-85fc-44ae-90f3-ae6c80203beb admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.445963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 43/84] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:38.446090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93d649-85fc-44ae-90f3-ae6c80203beb admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.450141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5943400-9e2e-476d-b4f0-ed8d8b35facf None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.451172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219be5bd-4c26-4f9b-88aa-d55661022b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.451655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219be5bd-4c26-4f9b-88aa-d55661022b07 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.452054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219be5bd-4c26-4f9b-88aa-d55661022b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.452212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219be5bd-4c26-4f9b-88aa-d55661022b07 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.460569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5943400-9e2e-476d-b4f0-ed8d8b35facf None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.465131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb633720-27eb-4a49-8686-4b657b69a8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.466033 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633720-27eb-4a49-8686-4b657b69a8ac admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.466317 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633720-27eb-4a49-8686-4b657b69a8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.466595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633720-27eb-4a49-8686-4b657b69a8ac admin admin] PATH_INFO: `/v3/users/7b3af60575154adca1fde17caac19ae8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.467396 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219be5bd-4c26-4f9b-88aa-d55661022b07 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.467781 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb633720-27eb-4a49-8686-4b657b69a8ac admin admin] RBAC: Authorizing `identity:get_user(user_id=7b3af60575154adca1fde17caac19ae8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.469603 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219be5bd-4c26-4f9b-88aa-d55661022b07 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.469944 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb633720-27eb-4a49-8686-4b657b69a8ac admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.471818 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 44/85] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/users/7b3af60575154adca1fde17caac19ae8 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.472568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb633720-27eb-4a49-8686-4b657b69a8ac admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.485881 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb633720-27eb-4a49-8686-4b657b69a8ac admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.486225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 42/86] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:38.487106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219be5bd-4c26-4f9b-88aa-d55661022b07 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.489901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9e2a3-71e8-4488-9a28-f669afcb26a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.490532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e2a3-71e8-4488-9a28-f669afcb26a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.490817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e2a3-71e8-4488-9a28-f669afcb26a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.491130 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e2a3-71e8-4488-9a28-f669afcb26a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.496072 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219be5bd-4c26-4f9b-88aa-d55661022b07 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.499489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9e2a3-71e8-4488-9a28-f669afcb26a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.500459 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacf6cb-ce1e-45ee-a36b-bc40b4151481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.501233 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacf6cb-ce1e-45ee-a36b-bc40b4151481 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.501327 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9e2a3-71e8-4488-9a28-f669afcb26a6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.501516 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacf6cb-ce1e-45ee-a36b-bc40b4151481 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.501812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacf6cb-ce1e-45ee-a36b-bc40b4151481 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.502962 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacf6cb-ce1e-45ee-a36b-bc40b4151481 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.504649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacf6cb-ce1e-45ee-a36b-bc40b4151481 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.506243 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 43/87] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.510796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 45/88] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:38.511176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacf6cb-ce1e-45ee-a36b-bc40b4151481 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.511883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9e2a3-71e8-4488-9a28-f669afcb26a6 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.521165 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9e2a3-71e8-4488-9a28-f669afcb26a6 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.523069 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacf6cb-ce1e-45ee-a36b-bc40b4151481 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.526258 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afdb4b-68bb-4fe5-bc8c-f46e07404a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.527099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afdb4b-68bb-4fe5-bc8c-f46e07404a50 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.527376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afdb4b-68bb-4fe5-bc8c-f46e07404a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.527532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729241-3b11-48ce-abfc-956d0d6b9f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.527632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afdb4b-68bb-4fe5-bc8c-f46e07404a50 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.528140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729241-3b11-48ce-abfc-956d0d6b9f95 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.528424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729241-3b11-48ce-abfc-956d0d6b9f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.528705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729241-3b11-48ce-abfc-956d0d6b9f95 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.528793 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afdb4b-68bb-4fe5-bc8c-f46e07404a50 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.530833 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afdb4b-68bb-4fe5-bc8c-f46e07404a50 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.537909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 46/89] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.537909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afdb4b-68bb-4fe5-bc8c-f46e07404a50 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.541367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12729241-3b11-48ce-abfc-956d0d6b9f95 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.542491 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afdb4b-68bb-4fe5-bc8c-f46e07404a50 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.543729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12729241-3b11-48ce-abfc-956d0d6b9f95 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.546825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fbd62-dee3-4204-a923-9db6f9daf932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.547452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fbd62-dee3-4204-a923-9db6f9daf932 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.547735 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fbd62-dee3-4204-a923-9db6f9daf932 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.548015 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fbd62-dee3-4204-a923-9db6f9daf932 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.548708 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fbd62-dee3-4204-a923-9db6f9daf932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.550606 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fbd62-dee3-4204-a923-9db6f9daf932 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.554330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 44/90] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:38.555416 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729241-3b11-48ce-abfc-956d0d6b9f95 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.564486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729241-3b11-48ce-abfc-956d0d6b9f95 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.568956 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cf452-de0f-4765-8a93-e974797349a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.570374 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cf452-de0f-4765-8a93-e974797349a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.570657 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cf452-de0f-4765-8a93-e974797349a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.570932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cf452-de0f-4765-8a93-e974797349a7 admin admin] PATH_INFO: `/v3/projects/ccbc591f84f8431abfe14b7bddd59ecf` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.572108 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cf452-de0f-4765-8a93-e974797349a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=ccbc591f84f8431abfe14b7bddd59ecf)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.574191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cf452-de0f-4765-8a93-e974797349a7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.575853 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 45/91] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/projects/ccbc591f84f8431abfe14b7bddd59ecf => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.576601 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cf452-de0f-4765-8a93-e974797349a7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.586019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cf452-de0f-4765-8a93-e974797349a7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.590289 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364b129-1ae7-4d85-b8a9-d1d9779960b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.590885 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364b129-1ae7-4d85-b8a9-d1d9779960b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.591171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364b129-1ae7-4d85-b8a9-d1d9779960b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.591450 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364b129-1ae7-4d85-b8a9-d1d9779960b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.592324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364b129-1ae7-4d85-b8a9-d1d9779960b2 admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8, user.id=a0f8f7fa57374efdb2df20708faea2ef) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:38.592634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364b129-1ae7-4d85-b8a9-d1d9779960b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.594437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364b129-1ae7-4d85-b8a9-d1d9779960b2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.599582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 46/92] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/role_assignments?user.id=a0f8f7fa57374efdb2df20708faea2ef&scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.600974 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364b129-1ae7-4d85-b8a9-d1d9779960b2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.611031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364b129-1ae7-4d85-b8a9-d1d9779960b2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.615724 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa786b8-5697-49e7-9d3a-d072f49e0da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.617190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa786b8-5697-49e7-9d3a-d072f49e0da5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.617566 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa786b8-5697-49e7-9d3a-d072f49e0da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.628684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa786b8-5697-49e7-9d3a-d072f49e0da5 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.628684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa786b8-5697-49e7-9d3a-d072f49e0da5 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.628684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa786b8-5697-49e7-9d3a-d072f49e0da5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.628684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 47/93] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.628684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa786b8-5697-49e7-9d3a-d072f49e0da5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.639063 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa786b8-5697-49e7-9d3a-d072f49e0da5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.643617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0bed4-07ec-4fc5-b2ac-b3919fe0ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.644286 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0bed4-07ec-4fc5-b2ac-b3919fe0ef87 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.644570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0bed4-07ec-4fc5-b2ac-b3919fe0ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.644845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0bed4-07ec-4fc5-b2ac-b3919fe0ef87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.645747 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0bed4-07ec-4fc5-b2ac-b3919fe0ef87 admin admin] RBAC: Adding query filter params (role.id=8f6eaa48bff44ea8822a222e38de2feb, scope.project.id=ccbc591f84f8431abfe14b7bddd59ecf, user.id=7b3af60575154adca1fde17caac19ae8) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:38.646087 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0bed4-07ec-4fc5-b2ac-b3919fe0ef87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.648414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0bed4-07ec-4fc5-b2ac-b3919fe0ef87 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.654647 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 48/94] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/role_assignments?user.id=7b3af60575154adca1fde17caac19ae8&scope.project.id=ccbc591f84f8431abfe14b7bddd59ecf&role.id=8f6eaa48bff44ea8822a222e38de2feb => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:38.655479 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0bed4-07ec-4fc5-b2ac-b3919fe0ef87 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:38.660140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 47/95] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:17:38 2021] POST /identity/v3/projects => generated 302 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:17:38.668359 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0bed4-07ec-4fc5-b2ac-b3919fe0ef87 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:38.736266 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085af3fe-9cc2-456b-bb81-0887db65ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:38.736905 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085af3fe-9cc2-456b-bb81-0887db65ad62 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:38.737131 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085af3fe-9cc2-456b-bb81-0887db65ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:38.737412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085af3fe-9cc2-456b-bb81-0887db65ad62 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:38.738302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085af3fe-9cc2-456b-bb81-0887db65ad62 admin admin] RBAC: Adding query filter params (role.id=8f120e43ae5140dbbe6dbdf88980fabe, scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8, user.id=7b3af60575154adca1fde17caac19ae8) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:38.738620 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085af3fe-9cc2-456b-bb81-0887db65ad62 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:38.740586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085af3fe-9cc2-456b-bb81-0887db65ad62 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:38.747862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:38 2021] GET /identity/v3/role_assignments?user.id=7b3af60575154adca1fde17caac19ae8&scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8&role.id=8f120e43ae5140dbbe6dbdf88980fabe => generated 259 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:40.659573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18e982-1ac3-4cce-b999-16c931754dd6 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:40.660096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18e982-1ac3-4cce-b999-16c931754dd6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:40.660399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18e982-1ac3-4cce-b999-16c931754dd6 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:40.662591 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 48/97] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:40.668710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f7557-1ff4-437c-9495-aee7b827168c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:40.669110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f7557-1ff4-437c-9495-aee7b827168c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:40.669302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f7557-1ff4-437c-9495-aee7b827168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:40.687293 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b87f7557-1ff4-437c-9495-aee7b827168c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:40.688474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b87f7557-1ff4-437c-9495-aee7b827168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:40.707800 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 50/98] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:40.738304 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18e982-1ac3-4cce-b999-16c931754dd6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:40.755512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18e982-1ac3-4cce-b999-16c931754dd6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:40.761353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3043c-cc89-4a72-906c-fba98460ea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:40.762172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3043c-cc89-4a72-906c-fba98460ea93 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:40.762450 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3043c-cc89-4a72-906c-fba98460ea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:40.762720 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3043c-cc89-4a72-906c-fba98460ea93 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:40.776560 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3043c-cc89-4a72-906c-fba98460ea93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:40.787530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-17f3043c-cc89-4a72-906c-fba98460ea93 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:40.789382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 49/99] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:40.796066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f7557-1ff4-437c-9495-aee7b827168c None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:40.805806 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f7557-1ff4-437c-9495-aee7b827168c None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:40.813811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349eb94-bd16-4aaa-9fc4-6133d97ab95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:40.814501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349eb94-bd16-4aaa-9fc4-6133d97ab95b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:40.814785 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349eb94-bd16-4aaa-9fc4-6133d97ab95b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:40.815064 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349eb94-bd16-4aaa-9fc4-6133d97ab95b admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:40.815807 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349eb94-bd16-4aaa-9fc4-6133d97ab95b admin admin] RBAC: Adding query filter params (name=member) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:40.816111 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349eb94-bd16-4aaa-9fc4-6133d97ab95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:40.817715 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349eb94-bd16-4aaa-9fc4-6133d97ab95b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:40.826727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 51/100] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:40.832707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3043c-cc89-4a72-906c-fba98460ea93 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:40.842666 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3043c-cc89-4a72-906c-fba98460ea93 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:40.849963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c48d11-0311-4d6a-a34b-b0b1e6598812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:40.851489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c48d11-0311-4d6a-a34b-b0b1e6598812 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:40.851769 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c48d11-0311-4d6a-a34b-b0b1e6598812 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:40.852042 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c48d11-0311-4d6a-a34b-b0b1e6598812 admin admin] PATH_INFO: `/v3/users/7b3af60575154adca1fde17caac19ae8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:40.853267 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c48d11-0311-4d6a-a34b-b0b1e6598812 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b3af60575154adca1fde17caac19ae8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:40.855440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c48d11-0311-4d6a-a34b-b0b1e6598812 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:40.857191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 50/101] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:40 2021] GET /identity/v3/users/7b3af60575154adca1fde17caac19ae8 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:40.863097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349eb94-bd16-4aaa-9fc4-6133d97ab95b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:40.873190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349eb94-bd16-4aaa-9fc4-6133d97ab95b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:40.882688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66900b3d-40c9-4ffe-8bc0-339132d39873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:40.883553 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66900b3d-40c9-4ffe-8bc0-339132d39873 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:40.883839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66900b3d-40c9-4ffe-8bc0-339132d39873 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:40.884116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66900b3d-40c9-4ffe-8bc0-339132d39873 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:40.885311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66900b3d-40c9-4ffe-8bc0-339132d39873 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:40.887681 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66900b3d-40c9-4ffe-8bc0-339132d39873 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:40.889349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 52/102] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:40 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:40.895763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c48d11-0311-4d6a-a34b-b0b1e6598812 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:40.906684 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c48d11-0311-4d6a-a34b-b0b1e6598812 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:40.911351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15bce-3daf-4031-ac4a-7cd1ea3c4c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:40.912167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15bce-3daf-4031-ac4a-7cd1ea3c4c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:40.912449 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15bce-3daf-4031-ac4a-7cd1ea3c4c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:40.912746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15bce-3daf-4031-ac4a-7cd1ea3c4c2a admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8/users/7b3af60575154adca1fde17caac19ae8/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:40.914776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e15bce-3daf-4031-ac4a-7cd1ea3c4c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a54648acdde4ad6bf01c13ca38c04a8, user_id=7b3af60575154adca1fde17caac19ae8, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:40.915949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-c6e15bce-3daf-4031-ac4a-7cd1ea3c4c2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:40.915949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:17:40.915949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:17:40.918049 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e15bce-3daf-4031-ac4a-7cd1ea3c4c2a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:40.990344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 51/103] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:17:40 2021] PUT /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8/users/7b3af60575154adca1fde17caac19ae8/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:17:41.213575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da7ed-7418-43ac-944a-95e1a960e0ed None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.213957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da7ed-7418-43ac-944a-95e1a960e0ed None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.214247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da7ed-7418-43ac-944a-95e1a960e0ed None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.215874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 53/104] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:41.222423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1e9cd-e522-4437-8933-994a960a40b6 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.222702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1e9cd-e522-4437-8933-994a960a40b6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.222954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1e9cd-e522-4437-8933-994a960a40b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.247111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-87c1e9cd-e522-4437-8933-994a960a40b6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:41.248333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-87c1e9cd-e522-4437-8933-994a960a40b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:41.320063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 52/105] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:41.347200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da7ed-7418-43ac-944a-95e1a960e0ed None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.361186 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da7ed-7418-43ac-944a-95e1a960e0ed None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.365770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9aefc-93c7-498b-b865-9daf66874d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.366774 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9aefc-93c7-498b-b865-9daf66874d2c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.367058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9aefc-93c7-498b-b865-9daf66874d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.367330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9aefc-93c7-498b-b865-9daf66874d2c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.379493 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9aefc-93c7-498b-b865-9daf66874d2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:41.387415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-d5a9aefc-93c7-498b-b865-9daf66874d2c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:17:41.388703 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 54/106] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:17:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:41.395985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1e9cd-e522-4437-8933-994a960a40b6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.406923 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1e9cd-e522-4437-8933-994a960a40b6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.411603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b07c4-5f9a-4c42-ba10-744dd04ae9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.412288 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b07c4-5f9a-4c42-ba10-744dd04ae9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.412566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b07c4-5f9a-4c42-ba10-744dd04ae9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.412990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b07c4-5f9a-4c42-ba10-744dd04ae9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.413840 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b07c4-5f9a-4c42-ba10-744dd04ae9f6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:41.414178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b07c4-5f9a-4c42-ba10-744dd04ae9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:41.415834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b07c4-5f9a-4c42-ba10-744dd04ae9f6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:41.426900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 53/107] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:41.433202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9aefc-93c7-498b-b865-9daf66874d2c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.443019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9aefc-93c7-498b-b865-9daf66874d2c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.448358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a893ea-c084-4acb-ae77-73c5d3725cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.449212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a893ea-c084-4acb-ae77-73c5d3725cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.449490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a893ea-c084-4acb-ae77-73c5d3725cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.449763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a893ea-c084-4acb-ae77-73c5d3725cc5 admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.451083 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a893ea-c084-4acb-ae77-73c5d3725cc5 admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:41.452950 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a893ea-c084-4acb-ae77-73c5d3725cc5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:41.454632 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 55/108] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:41 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:41.461014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b07c4-5f9a-4c42-ba10-744dd04ae9f6 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.471239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b07c4-5f9a-4c42-ba10-744dd04ae9f6 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.476712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda9f6f-472f-44c1-a171-5814ab647f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.477610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda9f6f-472f-44c1-a171-5814ab647f82 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.477961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda9f6f-472f-44c1-a171-5814ab647f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.478241 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda9f6f-472f-44c1-a171-5814ab647f82 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.479424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda9f6f-472f-44c1-a171-5814ab647f82 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:41.481837 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda9f6f-472f-44c1-a171-5814ab647f82 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:41.483582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 54/109] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:41 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:41.487710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa432342-34b5-45c3-9232-20f2e00294c3 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.488005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa432342-34b5-45c3-9232-20f2e00294c3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.488285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa432342-34b5-45c3-9232-20f2e00294c3 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.490186 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 56/110] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:41.494768 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda9f6f-472f-44c1-a171-5814ab647f82 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.499989 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75176ce-2b28-41e8-8be2-d0ca10d5d4df None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.500273 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75176ce-2b28-41e8-8be2-d0ca10d5d4df None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.500550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75176ce-2b28-41e8-8be2-d0ca10d5d4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.519892 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda9f6f-472f-44c1-a171-5814ab647f82 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.525730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-a75176ce-2b28-41e8-8be2-d0ca10d5d4df None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:41.527461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a75176ce-2b28-41e8-8be2-d0ca10d5d4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:41.532067 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde8408-18c5-4585-bdcf-9ed0c1260f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.533069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde8408-18c5-4585-bdcf-9ed0c1260f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.533353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde8408-18c5-4585-bdcf-9ed0c1260f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.533693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde8408-18c5-4585-bdcf-9ed0c1260f74 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8/users/a0f8f7fa57374efdb2df20708faea2ef/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.535770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde8408-18c5-4585-bdcf-9ed0c1260f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a54648acdde4ad6bf01c13ca38c04a8, user_id=a0f8f7fa57374efdb2df20708faea2ef, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:41.539245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde8408-18c5-4585-bdcf-9ed0c1260f74 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:41.545429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 57/111] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:41.573939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75176ce-2b28-41e8-8be2-d0ca10d5d4df None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.584364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75176ce-2b28-41e8-8be2-d0ca10d5d4df None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.590185 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060d8e7-10d8-4011-88a6-14ba660c2417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.591071 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060d8e7-10d8-4011-88a6-14ba660c2417 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.591352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060d8e7-10d8-4011-88a6-14ba660c2417 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.591618 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060d8e7-10d8-4011-88a6-14ba660c2417 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.603044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060d8e7-10d8-4011-88a6-14ba660c2417 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:41.611112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-0060d8e7-10d8-4011-88a6-14ba660c2417 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:41.612610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 58/112] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:17:41.620409 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060d8e7-10d8-4011-88a6-14ba660c2417 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.632654 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060d8e7-10d8-4011-88a6-14ba660c2417 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.641648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 55/113] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:17:41 2021] PUT /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8/users/a0f8f7fa57374efdb2df20708faea2ef/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:17:41.651946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cab9f-3e39-4f33-9779-98db71947825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.652686 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cab9f-3e39-4f33-9779-98db71947825 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.652972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cab9f-3e39-4f33-9779-98db71947825 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.653246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cab9f-3e39-4f33-9779-98db71947825 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.654430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cab9f-3e39-4f33-9779-98db71947825 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:41.656032 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa18a98-690a-47c5-a3d9-be85aa8a9483 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.656389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa18a98-690a-47c5-a3d9-be85aa8a9483 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.656805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa18a98-690a-47c5-a3d9-be85aa8a9483 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.661561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cab9f-3e39-4f33-9779-98db71947825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:41.661701 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 56/114] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:17:41.662231 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cab9f-3e39-4f33-9779-98db71947825 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:41.670227 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7a890-5fe4-417e-9737-59b479e29a25 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.670891 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7a890-5fe4-417e-9737-59b479e29a25 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.671371 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7a890-5fe4-417e-9737-59b479e29a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.690734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 59/115] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:41.698630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cab9f-3e39-4f33-9779-98db71947825 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.703399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e6d7a890-5fe4-417e-9737-59b479e29a25 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:41.704918 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e6d7a890-5fe4-417e-9737-59b479e29a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:41.709374 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cab9f-3e39-4f33-9779-98db71947825 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.771508 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 57/116] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:41.779830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403bd90-b71a-4bb7-81e5-42ad4c738833 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.780421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403bd90-b71a-4bb7-81e5-42ad4c738833 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.780915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403bd90-b71a-4bb7-81e5-42ad4c738833 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.783558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 58/117] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:41.785871 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f4a42-9d01-4d2e-85ce-b01fbcb77459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.785871 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f4a42-9d01-4d2e-85ce-b01fbcb77459 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.785871 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f4a42-9d01-4d2e-85ce-b01fbcb77459 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.785871 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f4a42-9d01-4d2e-85ce-b01fbcb77459 admin admin] PATH_INFO: `/v3/users/7b3af60575154adca1fde17caac19ae8` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.786730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f4a42-9d01-4d2e-85ce-b01fbcb77459 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b3af60575154adca1fde17caac19ae8)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:41.789757 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f4a42-9d01-4d2e-85ce-b01fbcb77459 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:41.790312 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e1093-ac98-4f4e-9268-99598c22c618 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.790841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e1093-ac98-4f4e-9268-99598c22c618 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.791363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e1093-ac98-4f4e-9268-99598c22c618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.791464 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 60/118] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:41 2021] GET /identity/v3/users/7b3af60575154adca1fde17caac19ae8 => generated 275 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:41.797799 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f4a42-9d01-4d2e-85ce-b01fbcb77459 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.810273 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f4a42-9d01-4d2e-85ce-b01fbcb77459 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.815456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bc990-b738-42c9-83b5-d0050a28eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.816335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bc990-b738-42c9-83b5-d0050a28eceb admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.816687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bc990-b738-42c9-83b5-d0050a28eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.816997 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-426e1093-ac98-4f4e-9268-99598c22c618 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:41.817100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bc990-b738-42c9-83b5-d0050a28eceb admin admin] PATH_INFO: `/v3/projects/ccbc591f84f8431abfe14b7bddd59ecf` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.818338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bc990-b738-42c9-83b5-d0050a28eceb admin admin] RBAC: Authorizing `identity:get_project(project_id=ccbc591f84f8431abfe14b7bddd59ecf)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:41.818992 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-426e1093-ac98-4f4e-9268-99598c22c618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:41.820519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bc990-b738-42c9-83b5-d0050a28eceb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:41.822821 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 61/119] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:41 2021] GET /identity/v3/projects/ccbc591f84f8431abfe14b7bddd59ecf => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:41.827425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bc990-b738-42c9-83b5-d0050a28eceb admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.833191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 59/120] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:41.834415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e1093-ac98-4f4e-9268-99598c22c618 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.845006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e1093-ac98-4f4e-9268-99598c22c618 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.848315 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bc990-b738-42c9-83b5-d0050a28eceb admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.851172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd0e27-29c0-484a-ae66-f246ef96ba32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.852058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd0e27-29c0-484a-ae66-f246ef96ba32 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.852345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd0e27-29c0-484a-ae66-f246ef96ba32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.852665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd0e27-29c0-484a-ae66-f246ef96ba32 admin admin] PATH_INFO: `/v3/projects/ccbc591f84f8431abfe14b7bddd59ecf/users/7b3af60575154adca1fde17caac19ae8/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.854610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd0e27-29c0-484a-ae66-f246ef96ba32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbc591f84f8431abfe14b7bddd59ecf, user_id=7b3af60575154adca1fde17caac19ae8, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:41.856274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28216b08-590b-4bb1-8f6e-6b9fc792778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.857260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd0e27-29c0-484a-ae66-f246ef96ba32 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:41.857702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28216b08-590b-4bb1-8f6e-6b9fc792778d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.858192 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28216b08-590b-4bb1-8f6e-6b9fc792778d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.858750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28216b08-590b-4bb1-8f6e-6b9fc792778d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.860482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28216b08-590b-4bb1-8f6e-6b9fc792778d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:41.863100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28216b08-590b-4bb1-8f6e-6b9fc792778d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:41.865112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 62/121] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:17:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:41.865916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28216b08-590b-4bb1-8f6e-6b9fc792778d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.876079 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28216b08-590b-4bb1-8f6e-6b9fc792778d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.883353 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d329429-99c7-4a90-b214-aa9bf8bfccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.884587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d329429-99c7-4a90-b214-aa9bf8bfccd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.884587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d329429-99c7-4a90-b214-aa9bf8bfccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.884951 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d329429-99c7-4a90-b214-aa9bf8bfccd9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.896195 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d329429-99c7-4a90-b214-aa9bf8bfccd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:41.904227 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-7d329429-99c7-4a90-b214-aa9bf8bfccd9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:17:41.905672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 63/122] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:17:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:41.906358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d329429-99c7-4a90-b214-aa9bf8bfccd9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:41.917535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d329429-99c7-4a90-b214-aa9bf8bfccd9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:41.922249 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b9b66-ae50-4b0c-95ed-fe787647d47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:41.923019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9b66-ae50-4b0c-95ed-fe787647d47d admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:41.923372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9b66-ae50-4b0c-95ed-fe787647d47d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:41.923775 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9b66-ae50-4b0c-95ed-fe787647d47d admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:41.924596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b9b66-ae50-4b0c-95ed-fe787647d47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:41.931498 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b9b66-ae50-4b0c-95ed-fe787647d47d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:41.937329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 60/123] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:17:41 2021] PUT /identity/v3/projects/ccbc591f84f8431abfe14b7bddd59ecf/users/7b3af60575154adca1fde17caac19ae8/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:17:41.938419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd0e27-29c0-484a-ae66-f246ef96ba32 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:42.009934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 64/124] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:17:41 2021] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:17:42.039054 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd0e27-29c0-484a-ae66-f246ef96ba32 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:42.048647 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc317876-b503-4186-ba8f-20d2105796a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:42.049653 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc317876-b503-4186-ba8f-20d2105796a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:42.050119 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc317876-b503-4186-ba8f-20d2105796a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:42.050549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc317876-b503-4186-ba8f-20d2105796a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:42.051563 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc317876-b503-4186-ba8f-20d2105796a2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:42.052063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc317876-b503-4186-ba8f-20d2105796a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:42.054131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc317876-b503-4186-ba8f-20d2105796a2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:42.067664 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 61/125] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:17:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:42.074713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b9b66-ae50-4b0c-95ed-fe787647d47d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:42.093957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b9b66-ae50-4b0c-95ed-fe787647d47d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:42.101800 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c130c-8ebf-49de-8955-82feb8c78514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:42.103088 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c130c-8ebf-49de-8955-82feb8c78514 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:42.103528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c130c-8ebf-49de-8955-82feb8c78514 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:42.103959 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c130c-8ebf-49de-8955-82feb8c78514 admin admin] PATH_INFO: `/v3/users/7b3af60575154adca1fde17caac19ae8` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:42.105632 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c130c-8ebf-49de-8955-82feb8c78514 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b3af60575154adca1fde17caac19ae8)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:42.113071 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c130c-8ebf-49de-8955-82feb8c78514 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:42.115434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 65/126] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:42 2021] GET /identity/v3/users/7b3af60575154adca1fde17caac19ae8 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:42.122159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc317876-b503-4186-ba8f-20d2105796a2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:42.138071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc317876-b503-4186-ba8f-20d2105796a2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:42.147763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb1a1c-05b2-4933-8786-ed7080be8aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:42.148721 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb1a1c-05b2-4933-8786-ed7080be8aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:42.149006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb1a1c-05b2-4933-8786-ed7080be8aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:42.149285 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb1a1c-05b2-4933-8786-ed7080be8aa0 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:42.150593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb1a1c-05b2-4933-8786-ed7080be8aa0 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:42.152747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb1a1c-05b2-4933-8786-ed7080be8aa0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:42.154853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 62/127] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:42 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:42.161317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c130c-8ebf-49de-8955-82feb8c78514 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:42.174638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c130c-8ebf-49de-8955-82feb8c78514 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:42.181143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5e999-0ad2-4b3a-88e1-8b74c9a01784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:42.182428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5e999-0ad2-4b3a-88e1-8b74c9a01784 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:42.182910 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5e999-0ad2-4b3a-88e1-8b74c9a01784 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:42.183458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5e999-0ad2-4b3a-88e1-8b74c9a01784 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8/users/7b3af60575154adca1fde17caac19ae8/roles/8f120e43ae5140dbbe6dbdf88980fabe` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:42.186066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5e999-0ad2-4b3a-88e1-8b74c9a01784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a54648acdde4ad6bf01c13ca38c04a8, user_id=7b3af60575154adca1fde17caac19ae8, role_id=8f120e43ae5140dbbe6dbdf88980fabe)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:42.190338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5e999-0ad2-4b3a-88e1-8b74c9a01784 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:42.252534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 66/128] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:17:42 2021] PUT /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8/users/7b3af60575154adca1fde17caac19ae8/roles/8f120e43ae5140dbbe6dbdf88980fabe => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:17:43.672148 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2249fa8-9590-45ce-8955-8da068c71f49 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:43.672648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2249fa8-9590-45ce-8955-8da068c71f49 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:43.672720 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2249fa8-9590-45ce-8955-8da068c71f49 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:43.674648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 63/129] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:43.687830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89c12c-d366-43a5-a79d-12ad57255ddc None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:43.688745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89c12c-d366-43a5-a79d-12ad57255ddc None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:43.689227 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89c12c-d366-43a5-a79d-12ad57255ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:43.711937 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-ec89c12c-d366-43a5-a79d-12ad57255ddc None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:43.713449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ec89c12c-d366-43a5-a79d-12ad57255ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:43.789305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 67/130] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:43.836858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2249fa8-9590-45ce-8955-8da068c71f49 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:43.849655 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2249fa8-9590-45ce-8955-8da068c71f49 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:43.857448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e743c21-05cc-4e4a-bc09-0bef2ed09d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:43.858740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e743c21-05cc-4e4a-bc09-0bef2ed09d21 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:43.859260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e743c21-05cc-4e4a-bc09-0bef2ed09d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:43.859741 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e743c21-05cc-4e4a-bc09-0bef2ed09d21 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:43.871318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e743c21-05cc-4e4a-bc09-0bef2ed09d21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:43.883533 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-1e743c21-05cc-4e4a-bc09-0bef2ed09d21 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:43.885077 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 64/131] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:43.892106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89c12c-d366-43a5-a79d-12ad57255ddc None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:43.902545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89c12c-d366-43a5-a79d-12ad57255ddc None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:43.907496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11adadd-a4b1-425e-a32a-8814367c7ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:43.908481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11adadd-a4b1-425e-a32a-8814367c7ffa admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:43.908973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11adadd-a4b1-425e-a32a-8814367c7ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:43.909454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11adadd-a4b1-425e-a32a-8814367c7ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:43.910447 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11adadd-a4b1-425e-a32a-8814367c7ffa admin admin] RBAC: Adding query filter params (name=member) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:43.910957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11adadd-a4b1-425e-a32a-8814367c7ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:43.912833 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11adadd-a4b1-425e-a32a-8814367c7ffa admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:43.925425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 68/132] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:43.932590 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e743c21-05cc-4e4a-bc09-0bef2ed09d21 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:43.943556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e743c21-05cc-4e4a-bc09-0bef2ed09d21 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:43.953450 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7d4e0-df0a-470d-a4bc-da89dc0b3d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:43.955128 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7d4e0-df0a-470d-a4bc-da89dc0b3d71 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:43.955128 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7d4e0-df0a-470d-a4bc-da89dc0b3d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:43.955363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7d4e0-df0a-470d-a4bc-da89dc0b3d71 admin admin] PATH_INFO: `/v3/users/7b3af60575154adca1fde17caac19ae8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:43.957924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7d4e0-df0a-470d-a4bc-da89dc0b3d71 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b3af60575154adca1fde17caac19ae8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:43.958815 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7d4e0-df0a-470d-a4bc-da89dc0b3d71 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:43.961191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 65/133] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:43 2021] GET /identity/v3/users/7b3af60575154adca1fde17caac19ae8 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:43.967624 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11adadd-a4b1-425e-a32a-8814367c7ffa admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:43.978696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11adadd-a4b1-425e-a32a-8814367c7ffa admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:43.983350 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9aa3a-9f65-45cb-8802-6366559091f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:43.984021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9aa3a-9f65-45cb-8802-6366559091f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:43.984309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9aa3a-9f65-45cb-8802-6366559091f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:43.984591 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9aa3a-9f65-45cb-8802-6366559091f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:43.997734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9aa3a-9f65-45cb-8802-6366559091f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:43.999668 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9aa3a-9f65-45cb-8802-6366559091f5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:44.012343 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 69/134] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:44.018707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7d4e0-df0a-470d-a4bc-da89dc0b3d71 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:44.029565 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7d4e0-df0a-470d-a4bc-da89dc0b3d71 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:44.037609 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a84390-549a-4c04-a800-34ec3fb31682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:44.038617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a84390-549a-4c04-a800-34ec3fb31682 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:44.038907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a84390-549a-4c04-a800-34ec3fb31682 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:44.039194 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a84390-549a-4c04-a800-34ec3fb31682 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:44.040418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a84390-549a-4c04-a800-34ec3fb31682 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:44.042536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a84390-549a-4c04-a800-34ec3fb31682 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:44.044223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 66/135] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:44 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:44.050884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9aa3a-9f65-45cb-8802-6366559091f5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:44.062902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9aa3a-9f65-45cb-8802-6366559091f5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:44.067464 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce327ce-fe2b-4cdd-85ed-b198062f2d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:44.068130 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce327ce-fe2b-4cdd-85ed-b198062f2d8b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:44.068509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce327ce-fe2b-4cdd-85ed-b198062f2d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:44.068896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce327ce-fe2b-4cdd-85ed-b198062f2d8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:44.070280 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce327ce-fe2b-4cdd-85ed-b198062f2d8b admin admin] RBAC: Adding query filter params (role.id=8f6eaa48bff44ea8822a222e38de2feb, scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8, user.id=7b3af60575154adca1fde17caac19ae8) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:44.070599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce327ce-fe2b-4cdd-85ed-b198062f2d8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:44.072452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce327ce-fe2b-4cdd-85ed-b198062f2d8b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:44.082503 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 70/136] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:44 2021] GET /identity/v3/role_assignments?user.id=7b3af60575154adca1fde17caac19ae8&scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8&role.id=8f6eaa48bff44ea8822a222e38de2feb => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:44.814303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d485f-943f-45f5-bbdc-b54b2cda51f9 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:44.814805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d485f-943f-45f5-bbdc-b54b2cda51f9 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:44.814878 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d485f-943f-45f5-bbdc-b54b2cda51f9 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:44.816776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 67/137] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:44.838397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e481e14-9057-4ade-873e-3336a1432f64 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:44.838397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e481e14-9057-4ade-873e-3336a1432f64 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:44.838397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e481e14-9057-4ade-873e-3336a1432f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:44.862889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-8e481e14-9057-4ade-873e-3336a1432f64 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:44.864398 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8e481e14-9057-4ade-873e-3336a1432f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:44.872761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 71/138] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:44.909333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d485f-943f-45f5-bbdc-b54b2cda51f9 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:44.922471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d485f-943f-45f5-bbdc-b54b2cda51f9 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:44.935690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc7c64-8266-4901-aebf-010aace2f80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:44.936507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc7c64-8266-4901-aebf-010aace2f80d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:44.936790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc7c64-8266-4901-aebf-010aace2f80d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:44.937073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc7c64-8266-4901-aebf-010aace2f80d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:44.952535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc7c64-8266-4901-aebf-010aace2f80d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:44.960116 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-bcbc7c64-8266-4901-aebf-010aace2f80d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:44.961609 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 68/139] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:44.968312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e481e14-9057-4ade-873e-3336a1432f64 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:44.982290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e481e14-9057-4ade-873e-3336a1432f64 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:44.987224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09576bf-0b05-4669-93ad-73674b1544dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:44.988120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09576bf-0b05-4669-93ad-73674b1544dc admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:44.988601 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09576bf-0b05-4669-93ad-73674b1544dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:44.989227 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09576bf-0b05-4669-93ad-73674b1544dc admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:44.990208 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09576bf-0b05-4669-93ad-73674b1544dc admin admin] RBAC: Adding query filter params (name=member) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:44.991205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09576bf-0b05-4669-93ad-73674b1544dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:44.994713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09576bf-0b05-4669-93ad-73674b1544dc admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.005413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 72/140] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:45.012573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc7c64-8266-4901-aebf-010aace2f80d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.022596 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc7c64-8266-4901-aebf-010aace2f80d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.034116 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97995014-fd1b-4233-ab0e-15d1e0d74fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.034929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97995014-fd1b-4233-ab0e-15d1e0d74fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.035217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97995014-fd1b-4233-ab0e-15d1e0d74fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.035497 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97995014-fd1b-4233-ab0e-15d1e0d74fe9 admin admin] PATH_INFO: `/v3/users/7b3af60575154adca1fde17caac19ae8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.036718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97995014-fd1b-4233-ab0e-15d1e0d74fe9 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b3af60575154adca1fde17caac19ae8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.039007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97995014-fd1b-4233-ab0e-15d1e0d74fe9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.040656 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 69/141] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/users/7b3af60575154adca1fde17caac19ae8 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:45.050533 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09576bf-0b05-4669-93ad-73674b1544dc admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.067044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09576bf-0b05-4669-93ad-73674b1544dc admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.074287 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892245a4-2661-4dd9-845e-c3fc28c5a3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.074946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892245a4-2661-4dd9-845e-c3fc28c5a3cd admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.075235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892245a4-2661-4dd9-845e-c3fc28c5a3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.075514 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892245a4-2661-4dd9-845e-c3fc28c5a3cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.093714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892245a4-2661-4dd9-845e-c3fc28c5a3cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.095562 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892245a4-2661-4dd9-845e-c3fc28c5a3cd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.107517 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 73/142] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:45.113896 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97995014-fd1b-4233-ab0e-15d1e0d74fe9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.130255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97995014-fd1b-4233-ab0e-15d1e0d74fe9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.141542 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240ec34-1de9-4a9e-8b59-d37b1178ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.142450 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240ec34-1de9-4a9e-8b59-d37b1178ad49 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.142737 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240ec34-1de9-4a9e-8b59-d37b1178ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.143023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240ec34-1de9-4a9e-8b59-d37b1178ad49 admin admin] PATH_INFO: `/v3/projects/ccbc591f84f8431abfe14b7bddd59ecf` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.144219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240ec34-1de9-4a9e-8b59-d37b1178ad49 admin admin] RBAC: Authorizing `identity:get_project(project_id=ccbc591f84f8431abfe14b7bddd59ecf)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.146339 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240ec34-1de9-4a9e-8b59-d37b1178ad49 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.148454 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 70/143] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/projects/ccbc591f84f8431abfe14b7bddd59ecf => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:45.155058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892245a4-2661-4dd9-845e-c3fc28c5a3cd admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.172380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892245a4-2661-4dd9-845e-c3fc28c5a3cd admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.182381 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2bf90-a3aa-43cc-beeb-0f8d88b07cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.183042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2bf90-a3aa-43cc-beeb-0f8d88b07cfb admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.183333 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2bf90-a3aa-43cc-beeb-0f8d88b07cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.183621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2bf90-a3aa-43cc-beeb-0f8d88b07cfb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.184477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2bf90-a3aa-43cc-beeb-0f8d88b07cfb admin admin] RBAC: Adding query filter params (role.id=8f6eaa48bff44ea8822a222e38de2feb, scope.project.id=ccbc591f84f8431abfe14b7bddd59ecf, user.id=7b3af60575154adca1fde17caac19ae8) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:45.184788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2bf90-a3aa-43cc-beeb-0f8d88b07cfb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.186688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2bf90-a3aa-43cc-beeb-0f8d88b07cfb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.197121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 74/144] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/role_assignments?user.id=7b3af60575154adca1fde17caac19ae8&scope.project.id=ccbc591f84f8431abfe14b7bddd59ecf&role.id=8f6eaa48bff44ea8822a222e38de2feb => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:45.415283 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a89329-1aed-497d-94ab-6decf0b62389 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.415613 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a89329-1aed-497d-94ab-6decf0b62389 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.415794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a89329-1aed-497d-94ab-6decf0b62389 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.417677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 71/145] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:45.423833 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229f352-544e-49ea-87ba-11da8f09fcb8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.424126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229f352-544e-49ea-87ba-11da8f09fcb8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.424410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229f352-544e-49ea-87ba-11da8f09fcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.450898 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-5229f352-544e-49ea-87ba-11da8f09fcb8 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:45.452109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5229f352-544e-49ea-87ba-11da8f09fcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:45.466630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 75/146] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:45.507863 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a89329-1aed-497d-94ab-6decf0b62389 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.524973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a89329-1aed-497d-94ab-6decf0b62389 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.533715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd71bfb-c505-423a-a8a0-b75c32fa2ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.534573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd71bfb-c505-423a-a8a0-b75c32fa2ddc admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.534861 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd71bfb-c505-423a-a8a0-b75c32fa2ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.535142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd71bfb-c505-423a-a8a0-b75c32fa2ddc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.552205 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd71bfb-c505-423a-a8a0-b75c32fa2ddc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:45.559883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-ebd71bfb-c505-423a-a8a0-b75c32fa2ddc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:17:45.561507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 72/147] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:45.568379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229f352-544e-49ea-87ba-11da8f09fcb8 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.583444 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229f352-544e-49ea-87ba-11da8f09fcb8 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.594869 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfb2d6-c685-4727-88b7-6e3dce3d7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.595560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfb2d6-c685-4727-88b7-6e3dce3d7963 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.595841 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfb2d6-c685-4727-88b7-6e3dce3d7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.596119 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfb2d6-c685-4727-88b7-6e3dce3d7963 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.596882 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfb2d6-c685-4727-88b7-6e3dce3d7963 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:45.597187 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfb2d6-c685-4727-88b7-6e3dce3d7963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.598851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfb2d6-c685-4727-88b7-6e3dce3d7963 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.613539 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 76/148] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:45.620309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd71bfb-c505-423a-a8a0-b75c32fa2ddc admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.630316 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd71bfb-c505-423a-a8a0-b75c32fa2ddc admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.641654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983a5ba-0cf9-48f2-8f73-1935d0b3730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.642599 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983a5ba-0cf9-48f2-8f73-1935d0b3730b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.642889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983a5ba-0cf9-48f2-8f73-1935d0b3730b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.643167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983a5ba-0cf9-48f2-8f73-1935d0b3730b admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.644420 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983a5ba-0cf9-48f2-8f73-1935d0b3730b admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.646578 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983a5ba-0cf9-48f2-8f73-1935d0b3730b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.648129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 73/149] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:45.648363 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cd65d-c84d-4f73-9ac2-e244d3fe0e52 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.648658 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cd65d-c84d-4f73-9ac2-e244d3fe0e52 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.648936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cd65d-c84d-4f73-9ac2-e244d3fe0e52 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.650883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 77/150] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:17:45.654497 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983a5ba-0cf9-48f2-8f73-1935d0b3730b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.657154 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35b9c-efc5-4779-8e80-98f9d9c3c4ec None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.657441 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35b9c-efc5-4779-8e80-98f9d9c3c4ec None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.657718 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35b9c-efc5-4779-8e80-98f9d9c3c4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.665734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983a5ba-0cf9-48f2-8f73-1935d0b3730b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.674882 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d812c7-782c-424e-b59b-f53c57f36e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.675543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d812c7-782c-424e-b59b-f53c57f36e3e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.675831 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d812c7-782c-424e-b59b-f53c57f36e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.676113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d812c7-782c-424e-b59b-f53c57f36e3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.688743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-6cf35b9c-efc5-4779-8e80-98f9d9c3c4ec None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:45.689808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d812c7-782c-424e-b59b-f53c57f36e3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.690044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-6cf35b9c-efc5-4779-8e80-98f9d9c3c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:45.691748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d812c7-782c-424e-b59b-f53c57f36e3e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.706628 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 74/151] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:45.712197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 78/152] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:45.713067 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d812c7-782c-424e-b59b-f53c57f36e3e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.722131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d812c7-782c-424e-b59b-f53c57f36e3e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.729428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b1e18-1f0e-4d2b-a93e-35652cb2c7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.730319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b1e18-1f0e-4d2b-a93e-35652cb2c7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.730609 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b1e18-1f0e-4d2b-a93e-35652cb2c7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.730894 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b1e18-1f0e-4d2b-a93e-35652cb2c7f8 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.732086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b1e18-1f0e-4d2b-a93e-35652cb2c7f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.734174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b1e18-1f0e-4d2b-a93e-35652cb2c7f8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.736002 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 75/153] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:45.743248 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf35b9c-efc5-4779-8e80-98f9d9c3c4ec None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.760473 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b1e18-1f0e-4d2b-a93e-35652cb2c7f8 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.763916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf35b9c-efc5-4779-8e80-98f9d9c3c4ec None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.775904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b1e18-1f0e-4d2b-a93e-35652cb2c7f8 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.778535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bde2f-dd20-4aa2-bbd8-f59ae3b1c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.779216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bde2f-dd20-4aa2-bbd8-f59ae3b1c0df admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.779504 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bde2f-dd20-4aa2-bbd8-f59ae3b1c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.779781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bde2f-dd20-4aa2-bbd8-f59ae3b1c0df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.780415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715ab63-fcdf-4bbd-8d0a-12f73a8c6173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.780614 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bde2f-dd20-4aa2-bbd8-f59ae3b1c0df admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8, user.id=a0f8f7fa57374efdb2df20708faea2ef) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:45.780913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bde2f-dd20-4aa2-bbd8-f59ae3b1c0df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.781221 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715ab63-fcdf-4bbd-8d0a-12f73a8c6173 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.781510 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715ab63-fcdf-4bbd-8d0a-12f73a8c6173 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.781791 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715ab63-fcdf-4bbd-8d0a-12f73a8c6173 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.782832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bde2f-dd20-4aa2-bbd8-f59ae3b1c0df admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.789509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 79/154] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/role_assignments?user.id=a0f8f7fa57374efdb2df20708faea2ef&scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:45.793914 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715ab63-fcdf-4bbd-8d0a-12f73a8c6173 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:45.801544 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-b715ab63-fcdf-4bbd-8d0a-12f73a8c6173 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:17:45.803574 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 76/155] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:17:45.810335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bde2f-dd20-4aa2-bbd8-f59ae3b1c0df admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.827273 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bde2f-dd20-4aa2-bbd8-f59ae3b1c0df admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.838527 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b32484-8bf0-4ae1-8ef5-e3a1395cb29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.839281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b32484-8bf0-4ae1-8ef5-e3a1395cb29f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.839493 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b32484-8bf0-4ae1-8ef5-e3a1395cb29f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.839768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b32484-8bf0-4ae1-8ef5-e3a1395cb29f admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.840543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b32484-8bf0-4ae1-8ef5-e3a1395cb29f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:45.840850 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b32484-8bf0-4ae1-8ef5-e3a1395cb29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.842532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b32484-8bf0-4ae1-8ef5-e3a1395cb29f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.857961 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 80/156] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:45.864438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715ab63-fcdf-4bbd-8d0a-12f73a8c6173 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.879509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715ab63-fcdf-4bbd-8d0a-12f73a8c6173 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.884689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc4cbc-c758-4738-97d3-920f01524ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.885579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc4cbc-c758-4738-97d3-920f01524ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.886174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc4cbc-c758-4738-97d3-920f01524ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.886465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc4cbc-c758-4738-97d3-920f01524ca4 admin admin] PATH_INFO: `/v3/users/7b3af60575154adca1fde17caac19ae8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.887704 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc4cbc-c758-4738-97d3-920f01524ca4 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b3af60575154adca1fde17caac19ae8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.889893 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc4cbc-c758-4738-97d3-920f01524ca4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.891553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 77/157] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/users/7b3af60575154adca1fde17caac19ae8 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:45.898052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b32484-8bf0-4ae1-8ef5-e3a1395cb29f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.912021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b32484-8bf0-4ae1-8ef5-e3a1395cb29f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.924698 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4906f-e676-48af-aef3-f60a94d8839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.926006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4906f-e676-48af-aef3-f60a94d8839e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.926486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4906f-e676-48af-aef3-f60a94d8839e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.926953 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4906f-e676-48af-aef3-f60a94d8839e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.941935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4906f-e676-48af-aef3-f60a94d8839e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.944172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4906f-e676-48af-aef3-f60a94d8839e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.957939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 81/158] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:45.962607 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc4cbc-c758-4738-97d3-920f01524ca4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:45.977031 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc4cbc-c758-4738-97d3-920f01524ca4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:45.989830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b693f-f4cf-4bdf-bde0-21d744720de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:45.991370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b693f-f4cf-4bdf-bde0-21d744720de0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:45.991824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b693f-f4cf-4bdf-bde0-21d744720de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:45.992455 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b693f-f4cf-4bdf-bde0-21d744720de0 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:45.993801 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b693f-f4cf-4bdf-bde0-21d744720de0 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:45.995927 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b693f-f4cf-4bdf-bde0-21d744720de0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:45.997841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 78/159] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:45 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:46.004538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4906f-e676-48af-aef3-f60a94d8839e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:46.015760 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4906f-e676-48af-aef3-f60a94d8839e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:46.026386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34eb36-0778-4b5e-86fe-ab7ab0f2b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:46.027199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34eb36-0778-4b5e-86fe-ab7ab0f2b584 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.027484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34eb36-0778-4b5e-86fe-ab7ab0f2b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.027799 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34eb36-0778-4b5e-86fe-ab7ab0f2b584 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.028742 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34eb36-0778-4b5e-86fe-ab7ab0f2b584 admin admin] RBAC: Adding query filter params (role.id=8f120e43ae5140dbbe6dbdf88980fabe, scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8, user.id=7b3af60575154adca1fde17caac19ae8) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:46.029054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34eb36-0778-4b5e-86fe-ab7ab0f2b584 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:46.030949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34eb36-0778-4b5e-86fe-ab7ab0f2b584 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:46.042809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 82/160] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:46 2021] GET /identity/v3/role_assignments?user.id=7b3af60575154adca1fde17caac19ae8&scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8&role.id=8f120e43ae5140dbbe6dbdf88980fabe => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:46.262721 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2c96a-c442-4760-874a-33512891a534 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.263092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2c96a-c442-4760-874a-33512891a534 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.263192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2c96a-c442-4760-874a-33512891a534 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.265303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 79/161] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:46.273554 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cab65a-e8e5-4719-9169-78228ae2ac7d None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.274465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cab65a-e8e5-4719-9169-78228ae2ac7d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.274755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cab65a-e8e5-4719-9169-78228ae2ac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.297789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-12cab65a-e8e5-4719-9169-78228ae2ac7d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:46.299109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-12cab65a-e8e5-4719-9169-78228ae2ac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:46.313299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 83/162] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:46.350660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2c96a-c442-4760-874a-33512891a534 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:46.367739 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2c96a-c442-4760-874a-33512891a534 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:46.372163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d6a6f-ea0e-4d8c-8f55-0de16f454859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:46.373102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d6a6f-ea0e-4d8c-8f55-0de16f454859 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.373395 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d6a6f-ea0e-4d8c-8f55-0de16f454859 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.373677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d6a6f-ea0e-4d8c-8f55-0de16f454859 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.386431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d6a6f-ea0e-4d8c-8f55-0de16f454859 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:46.395717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-f03d6a6f-ea0e-4d8c-8f55-0de16f454859 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:46.397812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 80/163] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:46.404531 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cab65a-e8e5-4719-9169-78228ae2ac7d None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:46.414477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cab65a-e8e5-4719-9169-78228ae2ac7d None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:46.426385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dd773-d790-44ba-a7ff-b3d494465fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:46.427074 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dd773-d790-44ba-a7ff-b3d494465fee admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.427357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dd773-d790-44ba-a7ff-b3d494465fee admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.427634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dd773-d790-44ba-a7ff-b3d494465fee admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.428437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dd773-d790-44ba-a7ff-b3d494465fee admin admin] RBAC: Adding query filter params (name=member) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:46.428837 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dd773-d790-44ba-a7ff-b3d494465fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:46.430403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dd773-d790-44ba-a7ff-b3d494465fee admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:46.439513 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 84/164] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:46.446051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d6a6f-ea0e-4d8c-8f55-0de16f454859 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:46.456021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d6a6f-ea0e-4d8c-8f55-0de16f454859 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:46.461363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0f806-1e2c-4b19-b505-8f3eef4e52ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:46.462272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0f806-1e2c-4b19-b505-8f3eef4e52ac admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.462566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0f806-1e2c-4b19-b505-8f3eef4e52ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.462831 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0f806-1e2c-4b19-b505-8f3eef4e52ac admin admin] PATH_INFO: `/v3/users/7c84bf7add6545f0b6f8356748e2bb9f` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.480613 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0f806-1e2c-4b19-b505-8f3eef4e52ac admin admin] RBAC: Authorizing `identity:get_user(user_id=7c84bf7add6545f0b6f8356748e2bb9f)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:46.482875 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0f806-1e2c-4b19-b505-8f3eef4e52ac admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:46.484678 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 81/165] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:46 2021] GET /identity/v3/users/7c84bf7add6545f0b6f8356748e2bb9f => generated 283 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:46.490945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dd773-d790-44ba-a7ff-b3d494465fee admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:46.503188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dd773-d790-44ba-a7ff-b3d494465fee admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:46.508242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40efbd-0782-4e1b-90d5-6d418559eeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:46.509196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40efbd-0782-4e1b-90d5-6d418559eeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.509657 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40efbd-0782-4e1b-90d5-6d418559eeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.510173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40efbd-0782-4e1b-90d5-6d418559eeb3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.519580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40efbd-0782-4e1b-90d5-6d418559eeb3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:46.522280 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40efbd-0782-4e1b-90d5-6d418559eeb3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:46.532480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 85/166] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:46.539581 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0f806-1e2c-4b19-b505-8f3eef4e52ac admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:46.550050 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0f806-1e2c-4b19-b505-8f3eef4e52ac admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:46.554885 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240e02-c70a-4314-8dd9-18b9c8ab5d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:46.556036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240e02-c70a-4314-8dd9-18b9c8ab5d7b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.556522 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240e02-c70a-4314-8dd9-18b9c8ab5d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.557016 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240e02-c70a-4314-8dd9-18b9c8ab5d7b admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.558458 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240e02-c70a-4314-8dd9-18b9c8ab5d7b admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:46.560821 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240e02-c70a-4314-8dd9-18b9c8ab5d7b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:46.562771 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 82/167] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:46 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:46.569504 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40efbd-0782-4e1b-90d5-6d418559eeb3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:46.579159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40efbd-0782-4e1b-90d5-6d418559eeb3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:46.584084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a802dbd-963e-4172-bf6f-a3c2eb6b8064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:46.585581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a802dbd-963e-4172-bf6f-a3c2eb6b8064 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.586071 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a802dbd-963e-4172-bf6f-a3c2eb6b8064 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.586634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a802dbd-963e-4172-bf6f-a3c2eb6b8064 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.587634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a802dbd-963e-4172-bf6f-a3c2eb6b8064 admin admin] RBAC: Adding query filter params (role.id=8f6eaa48bff44ea8822a222e38de2feb, scope.project.id=5f868635149a44f4a2b5cb7811d17563, user.id=7c84bf7add6545f0b6f8356748e2bb9f) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:46.588153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a802dbd-963e-4172-bf6f-a3c2eb6b8064 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:46.592439 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a802dbd-963e-4172-bf6f-a3c2eb6b8064 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:46.601918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 86/168] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:46 2021] GET /identity/v3/role_assignments?user.id=7c84bf7add6545f0b6f8356748e2bb9f&scope.project.id=5f868635149a44f4a2b5cb7811d17563&role.id=8f6eaa48bff44ea8822a222e38de2feb => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:46.775548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd776-529a-4589-9fe0-a7d2b0bc6fe2 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.775780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd776-529a-4589-9fe0-a7d2b0bc6fe2 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.776013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd776-529a-4589-9fe0-a7d2b0bc6fe2 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.777800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 83/169] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:46.784092 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f23e-aa73-4919-8327-d96d593c3b9c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.784668 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f23e-aa73-4919-8327-d96d593c3b9c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.785163 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9f23e-aa73-4919-8327-d96d593c3b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.804632 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-a7c9f23e-aa73-4919-8327-d96d593c3b9c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:46.806156 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a7c9f23e-aa73-4919-8327-d96d593c3b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:46.814105 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 87/170] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:46.839714 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dd776-529a-4589-9fe0-a7d2b0bc6fe2 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:46.852981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dd776-529a-4589-9fe0-a7d2b0bc6fe2 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:46.858097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ab5d7-e50a-4a20-9218-8cb3f2726dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:46.858886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ab5d7-e50a-4a20-9218-8cb3f2726dcd admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.859172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ab5d7-e50a-4a20-9218-8cb3f2726dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.859438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ab5d7-e50a-4a20-9218-8cb3f2726dcd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.870914 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ab5d7-e50a-4a20-9218-8cb3f2726dcd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:46.877734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-9e8ab5d7-e50a-4a20-9218-8cb3f2726dcd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:17:46.878961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 84/171] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:17:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:46.885340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9f23e-aa73-4919-8327-d96d593c3b9c None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:46.894617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9f23e-aa73-4919-8327-d96d593c3b9c None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:46.899219 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0026c-608f-42e5-a631-5cd3c46adbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:46.899961 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0026c-608f-42e5-a631-5cd3c46adbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.900224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0026c-608f-42e5-a631-5cd3c46adbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.900519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0026c-608f-42e5-a631-5cd3c46adbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.901243 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0026c-608f-42e5-a631-5cd3c46adbb9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:46.901538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0026c-608f-42e5-a631-5cd3c46adbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:46.903171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0026c-608f-42e5-a631-5cd3c46adbb9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:46.911991 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 88/172] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:46.918828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ab5d7-e50a-4a20-9218-8cb3f2726dcd admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:46.929925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ab5d7-e50a-4a20-9218-8cb3f2726dcd admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:46.934816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b05c83-3407-4f6c-b004-9522584a6ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:46.935744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b05c83-3407-4f6c-b004-9522584a6ded admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.936022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b05c83-3407-4f6c-b004-9522584a6ded admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.938617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b05c83-3407-4f6c-b004-9522584a6ded admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.938617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b05c83-3407-4f6c-b004-9522584a6ded admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:46.939639 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b05c83-3407-4f6c-b004-9522584a6ded admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:46.941604 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 85/173] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:46 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:46.947470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0026c-608f-42e5-a631-5cd3c46adbb9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:46.962602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0026c-608f-42e5-a631-5cd3c46adbb9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:46.967326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109497d-edbc-401b-9fe6-b98b0fee4842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:46.967979 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109497d-edbc-401b-9fe6-b98b0fee4842 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:46.968315 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109497d-edbc-401b-9fe6-b98b0fee4842 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:46.968587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109497d-edbc-401b-9fe6-b98b0fee4842 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:46.978138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109497d-edbc-401b-9fe6-b98b0fee4842 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:46.980015 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109497d-edbc-401b-9fe6-b98b0fee4842 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:46.989638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 89/174] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:46.996715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b05c83-3407-4f6c-b004-9522584a6ded admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:47.008076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b05c83-3407-4f6c-b004-9522584a6ded admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:47.012823 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170e2b8-9aa6-43e9-9c64-120c3780736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:47.013725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170e2b8-9aa6-43e9-9c64-120c3780736e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.014077 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170e2b8-9aa6-43e9-9c64-120c3780736e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.014356 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170e2b8-9aa6-43e9-9c64-120c3780736e admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.015534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170e2b8-9aa6-43e9-9c64-120c3780736e admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:47.017727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170e2b8-9aa6-43e9-9c64-120c3780736e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:47.019754 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 86/175] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:46 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:47.026948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109497d-edbc-401b-9fe6-b98b0fee4842 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:47.036487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109497d-edbc-401b-9fe6-b98b0fee4842 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:47.041690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce33f7-2d9d-4da0-b2a8-776718e5ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:47.042415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce33f7-2d9d-4da0-b2a8-776718e5ee14 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.042696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce33f7-2d9d-4da0-b2a8-776718e5ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.042967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce33f7-2d9d-4da0-b2a8-776718e5ee14 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.043875 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce33f7-2d9d-4da0-b2a8-776718e5ee14 admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=5f868635149a44f4a2b5cb7811d17563, user.id=a0f8f7fa57374efdb2df20708faea2ef) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:47.044236 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce33f7-2d9d-4da0-b2a8-776718e5ee14 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:47.046184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce33f7-2d9d-4da0-b2a8-776718e5ee14 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:47.054070 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 90/176] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:47 2021] GET /identity/v3/role_assignments?user.id=a0f8f7fa57374efdb2df20708faea2ef&scope.project.id=5f868635149a44f4a2b5cb7811d17563&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:47.125395 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdb8d7-251c-427e-8875-184ece7f2dc0 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.125729 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdb8d7-251c-427e-8875-184ece7f2dc0 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.125974 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdb8d7-251c-427e-8875-184ece7f2dc0 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.127904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 87/177] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:47.134691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9161b4-d753-4cfa-9879-3a46c223debc None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.135300 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9161b4-d753-4cfa-9879-3a46c223debc None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.136034 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9161b4-d753-4cfa-9879-3a46c223debc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.156216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-4f9161b4-d753-4cfa-9879-3a46c223debc None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:47.157820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4f9161b4-d753-4cfa-9879-3a46c223debc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:47.167348 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 91/178] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:47.195363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdb8d7-251c-427e-8875-184ece7f2dc0 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:47.209748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdb8d7-251c-427e-8875-184ece7f2dc0 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:47.215106 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c641f2-c998-457c-b962-21eadeb41818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:47.216274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c641f2-c998-457c-b962-21eadeb41818 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.216756 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c641f2-c998-457c-b962-21eadeb41818 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.217312 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c641f2-c998-457c-b962-21eadeb41818 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.230019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c641f2-c998-457c-b962-21eadeb41818 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:47.237807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-a4c641f2-c998-457c-b962-21eadeb41818 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:17:47.239579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 88/179] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:17:47 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:47.246324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9161b4-d753-4cfa-9879-3a46c223debc None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:47.255827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9161b4-d753-4cfa-9879-3a46c223debc None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:47.264901 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cef36-3edc-465a-957c-0a28b76b565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:47.265958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cef36-3edc-465a-957c-0a28b76b565d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.266480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cef36-3edc-465a-957c-0a28b76b565d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.266945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cef36-3edc-465a-957c-0a28b76b565d admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.268264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cef36-3edc-465a-957c-0a28b76b565d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:47.268913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cef36-3edc-465a-957c-0a28b76b565d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:47.270827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cef36-3edc-465a-957c-0a28b76b565d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:47.281081 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 92/180] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:17:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:47.288023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c641f2-c998-457c-b962-21eadeb41818 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:47.298627 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c641f2-c998-457c-b962-21eadeb41818 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:47.303636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2db019-6003-4dab-9568-aef143c6cb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:47.304851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2db019-6003-4dab-9568-aef143c6cb7b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.305326 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2db019-6003-4dab-9568-aef143c6cb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.305793 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2db019-6003-4dab-9568-aef143c6cb7b admin admin] PATH_INFO: `/v3/users/7c84bf7add6545f0b6f8356748e2bb9f` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.307298 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2db019-6003-4dab-9568-aef143c6cb7b admin admin] RBAC: Authorizing `identity:get_user(user_id=7c84bf7add6545f0b6f8356748e2bb9f)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:47.309758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2db019-6003-4dab-9568-aef143c6cb7b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:47.311638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 89/181] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:47 2021] GET /identity/v3/users/7c84bf7add6545f0b6f8356748e2bb9f => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:47.317748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cef36-3edc-465a-957c-0a28b76b565d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:47.328299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cef36-3edc-465a-957c-0a28b76b565d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:47.333222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba48516-998b-4e5b-9e38-429465367970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:47.334873 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba48516-998b-4e5b-9e38-429465367970 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.335368 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba48516-998b-4e5b-9e38-429465367970 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.335917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba48516-998b-4e5b-9e38-429465367970 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.344745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba48516-998b-4e5b-9e38-429465367970 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:47.346781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba48516-998b-4e5b-9e38-429465367970 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:47.356859 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 93/182] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:17:47.363266 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2db019-6003-4dab-9568-aef143c6cb7b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:47.374264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2db019-6003-4dab-9568-aef143c6cb7b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:47.379291 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5946-09f4-4210-9134-4dedea976d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:47.380476 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5946-09f4-4210-9134-4dedea976d47 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.381048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5946-09f4-4210-9134-4dedea976d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.381578 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5946-09f4-4210-9134-4dedea976d47 admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.383030 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5946-09f4-4210-9134-4dedea976d47 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:47.385357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5946-09f4-4210-9134-4dedea976d47 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:47.387553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 90/183] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:47 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:47.394151 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba48516-998b-4e5b-9e38-429465367970 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:47.404525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba48516-998b-4e5b-9e38-429465367970 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:47.409451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcde701-291c-4c3e-bb8d-d0a3dd239d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:47.410388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcde701-291c-4c3e-bb8d-d0a3dd239d9c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.410942 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcde701-291c-4c3e-bb8d-d0a3dd239d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.411466 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcde701-291c-4c3e-bb8d-d0a3dd239d9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.413277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcde701-291c-4c3e-bb8d-d0a3dd239d9c admin admin] RBAC: Adding query filter params (role.id=8f120e43ae5140dbbe6dbdf88980fabe, scope.project.id=5f868635149a44f4a2b5cb7811d17563, user.id=7c84bf7add6545f0b6f8356748e2bb9f) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:47.413796 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcde701-291c-4c3e-bb8d-d0a3dd239d9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:47.416086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcde701-291c-4c3e-bb8d-d0a3dd239d9c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:47.423036 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 94/184] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:47 2021] GET /identity/v3/role_assignments?user.id=7c84bf7add6545f0b6f8356748e2bb9f&scope.project.id=5f868635149a44f4a2b5cb7811d17563&role.id=8f120e43ae5140dbbe6dbdf88980fabe => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:47.512372 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a63e40-a5b9-4b7d-b7aa-6dc948850611 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.512994 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a63e40-a5b9-4b7d-b7aa-6dc948850611 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.513464 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a63e40-a5b9-4b7d-b7aa-6dc948850611 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.515551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 91/185] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:47.522547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0fc48-7a34-4f91-b39a-6d297afa1013 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.523149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0fc48-7a34-4f91-b39a-6d297afa1013 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.523619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0fc48-7a34-4f91-b39a-6d297afa1013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.542842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-bac0fc48-7a34-4f91-b39a-6d297afa1013 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:47.544357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-bac0fc48-7a34-4f91-b39a-6d297afa1013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:47.552527 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 95/186] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:47.576817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a63e40-a5b9-4b7d-b7aa-6dc948850611 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:47.590763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a63e40-a5b9-4b7d-b7aa-6dc948850611 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:47.595529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da55d9-8b40-4a2b-bc79-8fe82041d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:47.596576 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da55d9-8b40-4a2b-bc79-8fe82041d037 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.597054 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da55d9-8b40-4a2b-bc79-8fe82041d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.597537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da55d9-8b40-4a2b-bc79-8fe82041d037 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.599922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da55d9-8b40-4a2b-bc79-8fe82041d037 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:47.601962 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da55d9-8b40-4a2b-bc79-8fe82041d037 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:47.603794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 92/187] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:17:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:47.610693 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0fc48-7a34-4f91-b39a-6d297afa1013 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:47.619435 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0fc48-7a34-4f91-b39a-6d297afa1013 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:47.623956 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f752-beda-4043-b768-213d73cc80eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:47.624612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f752-beda-4043-b768-213d73cc80eb admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:47.624889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f752-beda-4043-b768-213d73cc80eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:47.625158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f752-beda-4043-b768-213d73cc80eb admin admin] PATH_INFO: `/v3/groups` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:47.625840 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f752-beda-4043-b768-213d73cc80eb admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:47.626891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-cb62f752-beda-4043-b768-213d73cc80eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:47.626891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:17:47.626891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:17:47.628055 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f752-beda-4043-b768-213d73cc80eb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:47.715600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 96/188] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Aug 29 14:17:47 2021] POST /identity/v3/groups => generated 229 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:17:48.841415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7341c-4264-43e6-a82b-213fd32657c4 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:48.841961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7341c-4264-43e6-a82b-213fd32657c4 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:48.842260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7341c-4264-43e6-a82b-213fd32657c4 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:48.844157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 93/189] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:48.850197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2075d-4a79-415d-ae1a-c2a04855ca0b None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:48.850609 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2075d-4a79-415d-ae1a-c2a04855ca0b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:48.850779 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2075d-4a79-415d-ae1a-c2a04855ca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:48.869300 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-eef2075d-4a79-415d-ae1a-c2a04855ca0b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:48.870500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-eef2075d-4a79-415d-ae1a-c2a04855ca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:48.878031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 97/190] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:48.902887 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7341c-4264-43e6-a82b-213fd32657c4 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:48.915708 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7341c-4264-43e6-a82b-213fd32657c4 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:48.920040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb536dd-eb5c-456f-974b-09b1d35d0a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:48.920832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb536dd-eb5c-456f-974b-09b1d35d0a45 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:48.921109 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb536dd-eb5c-456f-974b-09b1d35d0a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:48.921378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb536dd-eb5c-456f-974b-09b1d35d0a45 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:48.933360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb536dd-eb5c-456f-974b-09b1d35d0a45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:48.940458 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-0eb536dd-eb5c-456f-974b-09b1d35d0a45 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:48.941727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 94/191] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:48.948987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2075d-4a79-415d-ae1a-c2a04855ca0b None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:48.958377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2075d-4a79-415d-ae1a-c2a04855ca0b None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:48.963330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8301-8257-4c6b-960b-1166bd0cd2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:48.964003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8301-8257-4c6b-960b-1166bd0cd2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:48.964281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8301-8257-4c6b-960b-1166bd0cd2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:48.964550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8301-8257-4c6b-960b-1166bd0cd2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:48.965289 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d8301-8257-4c6b-960b-1166bd0cd2c9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:48.965617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d8301-8257-4c6b-960b-1166bd0cd2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:48.967367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d8301-8257-4c6b-960b-1166bd0cd2c9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:48.977160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 98/192] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:48.983399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb536dd-eb5c-456f-974b-09b1d35d0a45 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:48.993994 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb536dd-eb5c-456f-974b-09b1d35d0a45 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:48.998618 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d916e2-e8d3-402f-ba73-9b22e17c32ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:48.999547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d916e2-e8d3-402f-ba73-9b22e17c32ee admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:48.999893 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d916e2-e8d3-402f-ba73-9b22e17c32ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.000236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d916e2-e8d3-402f-ba73-9b22e17c32ee admin admin] PATH_INFO: `/v3/users/7c84bf7add6545f0b6f8356748e2bb9f` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.001514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d916e2-e8d3-402f-ba73-9b22e17c32ee admin admin] RBAC: Authorizing `identity:get_user(user_id=7c84bf7add6545f0b6f8356748e2bb9f)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:49.003743 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d916e2-e8d3-402f-ba73-9b22e17c32ee admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:49.006422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 95/193] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:48 2021] GET /identity/v3/users/7c84bf7add6545f0b6f8356748e2bb9f => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:49.012779 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8301-8257-4c6b-960b-1166bd0cd2c9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:49.023257 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8301-8257-4c6b-960b-1166bd0cd2c9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:49.028079 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362622c0-46bc-413e-a4ae-215f2e713045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:49.029191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362622c0-46bc-413e-a4ae-215f2e713045 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.029664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362622c0-46bc-413e-a4ae-215f2e713045 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.030202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362622c0-46bc-413e-a4ae-215f2e713045 admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.031654 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362622c0-46bc-413e-a4ae-215f2e713045 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:49.034003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362622c0-46bc-413e-a4ae-215f2e713045 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:49.041928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 99/194] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:49 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:49.043544 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d916e2-e8d3-402f-ba73-9b22e17c32ee admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:49.054942 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d916e2-e8d3-402f-ba73-9b22e17c32ee admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:49.059937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916a26f-1379-4fac-a6f9-385942998058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:49.061088 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916a26f-1379-4fac-a6f9-385942998058 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.061587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916a26f-1379-4fac-a6f9-385942998058 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.062080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916a26f-1379-4fac-a6f9-385942998058 admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563/users/7c84bf7add6545f0b6f8356748e2bb9f/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.064347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916a26f-1379-4fac-a6f9-385942998058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f868635149a44f4a2b5cb7811d17563, user_id=7c84bf7add6545f0b6f8356748e2bb9f, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:49.067247 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916a26f-1379-4fac-a6f9-385942998058 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:49.139150 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 96/195] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:17:49 2021] PUT /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563/users/7c84bf7add6545f0b6f8356748e2bb9f/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:17:49.294386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1ce2a-9cd9-4fe3-bdc7-513b48c720b4 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.294744 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1ce2a-9cd9-4fe3-bdc7-513b48c720b4 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.294952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1ce2a-9cd9-4fe3-bdc7-513b48c720b4 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.296944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 100/196] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:49.304258 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a39e9b-be3c-4e0a-b4e4-c1f5d0ff03bb None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.304545 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a39e9b-be3c-4e0a-b4e4-c1f5d0ff03bb None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.304832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a39e9b-be3c-4e0a-b4e4-c1f5d0ff03bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.324264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-b2a39e9b-be3c-4e0a-b4e4-c1f5d0ff03bb None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:49.325540 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b2a39e9b-be3c-4e0a-b4e4-c1f5d0ff03bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:49.384892 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 97/197] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:49.408881 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1ce2a-9cd9-4fe3-bdc7-513b48c720b4 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:49.421266 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1ce2a-9cd9-4fe3-bdc7-513b48c720b4 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:49.425595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c65cc-65e4-45fc-af56-3b5cb6bed9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:49.426406 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c65cc-65e4-45fc-af56-3b5cb6bed9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.426685 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c65cc-65e4-45fc-af56-3b5cb6bed9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.426954 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c65cc-65e4-45fc-af56-3b5cb6bed9d7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.437814 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c65cc-65e4-45fc-af56-3b5cb6bed9d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:49.445160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-a68c65cc-65e4-45fc-af56-3b5cb6bed9d7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:17:49.446446 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 101/198] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:17:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:49.452851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a39e9b-be3c-4e0a-b4e4-c1f5d0ff03bb None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:49.463011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a39e9b-be3c-4e0a-b4e4-c1f5d0ff03bb None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:49.467509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483f1cf-551f-4853-854b-9b8cfff38d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:49.468236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483f1cf-551f-4853-854b-9b8cfff38d3b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.468513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483f1cf-551f-4853-854b-9b8cfff38d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.468786 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483f1cf-551f-4853-854b-9b8cfff38d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.469586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483f1cf-551f-4853-854b-9b8cfff38d3b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:49.469912 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483f1cf-551f-4853-854b-9b8cfff38d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:49.471551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483f1cf-551f-4853-854b-9b8cfff38d3b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:49.481199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 98/199] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:49.487141 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c65cc-65e4-45fc-af56-3b5cb6bed9d7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:49.497946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c65cc-65e4-45fc-af56-3b5cb6bed9d7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:49.502788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037670b3-8f1b-4e89-9764-ed1c13442e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:49.503657 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037670b3-8f1b-4e89-9764-ed1c13442e13 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.503932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037670b3-8f1b-4e89-9764-ed1c13442e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.504202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037670b3-8f1b-4e89-9764-ed1c13442e13 admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.505548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037670b3-8f1b-4e89-9764-ed1c13442e13 admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:49.507496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037670b3-8f1b-4e89-9764-ed1c13442e13 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:49.509340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 102/200] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:49 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:49.515550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483f1cf-551f-4853-854b-9b8cfff38d3b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:49.526342 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483f1cf-551f-4853-854b-9b8cfff38d3b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:49.530844 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4f859-f09a-4d5d-bd4e-9e6642e41cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:49.531751 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4f859-f09a-4d5d-bd4e-9e6642e41cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.532028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4f859-f09a-4d5d-bd4e-9e6642e41cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.532332 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4f859-f09a-4d5d-bd4e-9e6642e41cb4 admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.533512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4f859-f09a-4d5d-bd4e-9e6642e41cb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:49.535753 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4f859-f09a-4d5d-bd4e-9e6642e41cb4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:49.537572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 99/201] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:49 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:49.543825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037670b3-8f1b-4e89-9764-ed1c13442e13 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:49.554746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037670b3-8f1b-4e89-9764-ed1c13442e13 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:49.559775 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df968-bb3c-48c4-b605-06429d5a4daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:49.560763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df968-bb3c-48c4-b605-06429d5a4daf admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.561080 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df968-bb3c-48c4-b605-06429d5a4daf admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.561455 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df968-bb3c-48c4-b605-06429d5a4daf admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563/users/a0f8f7fa57374efdb2df20708faea2ef/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.563906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8df968-bb3c-48c4-b605-06429d5a4daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f868635149a44f4a2b5cb7811d17563, user_id=a0f8f7fa57374efdb2df20708faea2ef, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:49.567058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8df968-bb3c-48c4-b605-06429d5a4daf admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:49.644307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9143f55-e3b4-494a-a9d2-181d77a42369 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.644672 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9143f55-e3b4-494a-a9d2-181d77a42369 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.644880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9143f55-e3b4-494a-a9d2-181d77a42369 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.647529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 100/202] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:17:49.652842 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936eb1f-e9b0-4134-8c6b-a29544a7fbe6 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.653129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936eb1f-e9b0-4134-8c6b-a29544a7fbe6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.653403 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936eb1f-e9b0-4134-8c6b-a29544a7fbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.663925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 103/203] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:17:49 2021] PUT /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563/users/a0f8f7fa57374efdb2df20708faea2ef/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:17:49.672310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-d936eb1f-e9b0-4134-8c6b-a29544a7fbe6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:49.673546 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d936eb1f-e9b0-4134-8c6b-a29544a7fbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:49.738386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 101/204] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:49.764234 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df968-bb3c-48c4-b605-06429d5a4daf admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:49.777715 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df968-bb3c-48c4-b605-06429d5a4daf admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:49.782915 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d8968-b6e3-44dc-bf0e-e29621a5469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:49.784012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d8968-b6e3-44dc-bf0e-e29621a5469d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.784511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d8968-b6e3-44dc-bf0e-e29621a5469d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.785083 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d8968-b6e3-44dc-bf0e-e29621a5469d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.797848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d8968-b6e3-44dc-bf0e-e29621a5469d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:49.806096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-2a4d8968-b6e3-44dc-bf0e-e29621a5469d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:17:49.808019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 104/205] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:17:49 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:17:49.814752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936eb1f-e9b0-4134-8c6b-a29544a7fbe6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:49.825473 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936eb1f-e9b0-4134-8c6b-a29544a7fbe6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:49.830559 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1719d83-6e5f-4dca-95a9-d23473843b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:49.831529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719d83-6e5f-4dca-95a9-d23473843b19 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.831990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719d83-6e5f-4dca-95a9-d23473843b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.832437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719d83-6e5f-4dca-95a9-d23473843b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.833400 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1719d83-6e5f-4dca-95a9-d23473843b19 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:49.833934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1719d83-6e5f-4dca-95a9-d23473843b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:49.836480 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1719d83-6e5f-4dca-95a9-d23473843b19 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:49.845722 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 102/206] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:17:49 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:49.852555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d8968-b6e3-44dc-bf0e-e29621a5469d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:49.863968 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d8968-b6e3-44dc-bf0e-e29621a5469d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:49.873044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0f932-884f-4208-b6f8-54bf5fa9ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:49.874362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0f932-884f-4208-b6f8-54bf5fa9ad44 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.874860 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0f932-884f-4208-b6f8-54bf5fa9ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.875400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0f932-884f-4208-b6f8-54bf5fa9ad44 admin admin] PATH_INFO: `/v3/users/7c84bf7add6545f0b6f8356748e2bb9f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.877114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0f932-884f-4208-b6f8-54bf5fa9ad44 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c84bf7add6545f0b6f8356748e2bb9f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:49.879818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0f932-884f-4208-b6f8-54bf5fa9ad44 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:49.883282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 105/207] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:49 2021] GET /identity/v3/users/7c84bf7add6545f0b6f8356748e2bb9f => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:49.890709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1719d83-6e5f-4dca-95a9-d23473843b19 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:49.905071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1719d83-6e5f-4dca-95a9-d23473843b19 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:49.909829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d5c0f-fdf4-418f-9693-ee05878e52ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:49.910823 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d5c0f-fdf4-418f-9693-ee05878e52ea admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.911170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d5c0f-fdf4-418f-9693-ee05878e52ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.911511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d5c0f-fdf4-418f-9693-ee05878e52ea admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.912774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d5c0f-fdf4-418f-9693-ee05878e52ea admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:49.915046 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d5c0f-fdf4-418f-9693-ee05878e52ea admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:49.916963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 103/208] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:49 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:49.923181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0f932-884f-4208-b6f8-54bf5fa9ad44 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:49.937031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0f932-884f-4208-b6f8-54bf5fa9ad44 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:49.941936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ac12a-a7ae-41cb-af8d-38a95980464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:49.942830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ac12a-a7ae-41cb-af8d-38a95980464a admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.943139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ac12a-a7ae-41cb-af8d-38a95980464a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.944411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ac12a-a7ae-41cb-af8d-38a95980464a admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563/users/7c84bf7add6545f0b6f8356748e2bb9f/roles/8f120e43ae5140dbbe6dbdf88980fabe` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.946814 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ac12a-a7ae-41cb-af8d-38a95980464a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f868635149a44f4a2b5cb7811d17563, user_id=7c84bf7add6545f0b6f8356748e2bb9f, role_id=8f120e43ae5140dbbe6dbdf88980fabe)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:49.949722 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ac12a-a7ae-41cb-af8d-38a95980464a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:49.955304 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3c8c-ff29-438a-b2a0-5d635605cb28 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.955508 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3c8c-ff29-438a-b2a0-5d635605cb28 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.955782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3c8c-ff29-438a-b2a0-5d635605cb28 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.957673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 104/209] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:17:49.964441 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504fed-5b69-4832-b8cf-f02965744e85 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:49.964953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504fed-5b69-4832-b8cf-f02965744e85 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:49.965054 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504fed-5b69-4832-b8cf-f02965744e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:49.982877 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-21504fed-5b69-4832-b8cf-f02965744e85 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:49.984167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-21504fed-5b69-4832-b8cf-f02965744e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:49.991862 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 105/210] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:50.018615 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21504fed-5b69-4832-b8cf-f02965744e85 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:50.028214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21504fed-5b69-4832-b8cf-f02965744e85 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:50.032606 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008fe5b-96b0-4e52-b892-b1d2dfdef758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:50.033413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008fe5b-96b0-4e52-b892-b1d2dfdef758 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:50.033689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008fe5b-96b0-4e52-b892-b1d2dfdef758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:50.033997 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008fe5b-96b0-4e52-b892-b1d2dfdef758 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:50.035168 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008fe5b-96b0-4e52-b892-b1d2dfdef758 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:50.036848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008fe5b-96b0-4e52-b892-b1d2dfdef758 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:50.038830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 106/211] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:17:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:50.044838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008fe5b-96b0-4e52-b892-b1d2dfdef758 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:50.055861 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008fe5b-96b0-4e52-b892-b1d2dfdef758 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:50.060494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1202ec-505a-4388-b912-aa252ffa0dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:50.061161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1202ec-505a-4388-b912-aa252ffa0dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:50.067070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1202ec-505a-4388-b912-aa252ffa0dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:50.067070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1202ec-505a-4388-b912-aa252ffa0dc5 admin admin] PATH_INFO: `/v3/groups` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:50.067070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1202ec-505a-4388-b912-aa252ffa0dc5 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:50.067070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-be1202ec-505a-4388-b912-aa252ffa0dc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:50.067070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:17:50.067070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:17:50.067070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1202ec-505a-4388-b912-aa252ffa0dc5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:50.107406 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 106/212] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:17:49 2021] PUT /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563/users/7c84bf7add6545f0b6f8356748e2bb9f/roles/8f120e43ae5140dbbe6dbdf88980fabe => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:17:50.218883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 107/213] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Aug 29 14:17:50 2021] POST /identity/v3/groups => generated 226 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:17:51.458333 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdd6ac-d3f6-44f0-9ac5-ad82f87b5ac9 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:51.459935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdd6ac-d3f6-44f0-9ac5-ad82f87b5ac9 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:51.460410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdd6ac-d3f6-44f0-9ac5-ad82f87b5ac9 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:51.462561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 107/214] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:51.469194 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dafd1-c0fe-40f8-9e35-de734ed5fec7 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:51.470160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dafd1-c0fe-40f8-9e35-de734ed5fec7 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:51.470648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dafd1-c0fe-40f8-9e35-de734ed5fec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:51.491867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-013dafd1-c0fe-40f8-9e35-de734ed5fec7 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:51.493369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-013dafd1-c0fe-40f8-9e35-de734ed5fec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:51.566130 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 108/215] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:51.607185 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdd6ac-d3f6-44f0-9ac5-ad82f87b5ac9 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:51.623541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdd6ac-d3f6-44f0-9ac5-ad82f87b5ac9 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:51.628430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70fc2-19a5-4c4e-91e2-5ab88d0ad69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:51.629480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70fc2-19a5-4c4e-91e2-5ab88d0ad69b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:51.630009 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70fc2-19a5-4c4e-91e2-5ab88d0ad69b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:51.630499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70fc2-19a5-4c4e-91e2-5ab88d0ad69b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:51.648766 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde70fc2-19a5-4c4e-91e2-5ab88d0ad69b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:51.655816 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-dde70fc2-19a5-4c4e-91e2-5ab88d0ad69b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:51.657283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 108/216] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:51.663986 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dafd1-c0fe-40f8-9e35-de734ed5fec7 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:51.673353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dafd1-c0fe-40f8-9e35-de734ed5fec7 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:51.682065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc233-6cd3-4eeb-92e6-cfa824a3fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:51.682999 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc233-6cd3-4eeb-92e6-cfa824a3fabc admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:51.683468 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc233-6cd3-4eeb-92e6-cfa824a3fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:51.683930 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc233-6cd3-4eeb-92e6-cfa824a3fabc admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:51.684867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cc233-6cd3-4eeb-92e6-cfa824a3fabc admin admin] RBAC: Adding query filter params (name=member) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:51.685377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cc233-6cd3-4eeb-92e6-cfa824a3fabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:51.687431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cc233-6cd3-4eeb-92e6-cfa824a3fabc admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:51.700403 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 109/217] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:51.706644 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70fc2-19a5-4c4e-91e2-5ab88d0ad69b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:51.719024 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70fc2-19a5-4c4e-91e2-5ab88d0ad69b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:51.723960 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ee891-dea8-4cab-aa5b-f4849f0a1c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:51.725282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ee891-dea8-4cab-aa5b-f4849f0a1c3d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:51.725824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ee891-dea8-4cab-aa5b-f4849f0a1c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:51.726363 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ee891-dea8-4cab-aa5b-f4849f0a1c3d admin admin] PATH_INFO: `/v3/users/7c84bf7add6545f0b6f8356748e2bb9f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:51.730688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ee891-dea8-4cab-aa5b-f4849f0a1c3d admin admin] RBAC: Authorizing `identity:get_user(user_id=7c84bf7add6545f0b6f8356748e2bb9f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:51.733223 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ee891-dea8-4cab-aa5b-f4849f0a1c3d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:51.735620 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 109/218] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:51 2021] GET /identity/v3/users/7c84bf7add6545f0b6f8356748e2bb9f => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:51.742130 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc233-6cd3-4eeb-92e6-cfa824a3fabc admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:51.752272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc233-6cd3-4eeb-92e6-cfa824a3fabc admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:51.761584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7e89d-9a5f-4cd1-b958-8a79e33e06f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:51.762562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7e89d-9a5f-4cd1-b958-8a79e33e06f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:51.763042 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7e89d-9a5f-4cd1-b958-8a79e33e06f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:51.763505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7e89d-9a5f-4cd1-b958-8a79e33e06f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:51.774803 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7e89d-9a5f-4cd1-b958-8a79e33e06f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:51.776792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7e89d-9a5f-4cd1-b958-8a79e33e06f7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:51.787187 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 110/219] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:51.793540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ee891-dea8-4cab-aa5b-f4849f0a1c3d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:51.805452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ee891-dea8-4cab-aa5b-f4849f0a1c3d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:51.812083 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec88b-5d09-4087-bba3-e2af3d0a5baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:51.813244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec88b-5d09-4087-bba3-e2af3d0a5baf admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:51.813745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec88b-5d09-4087-bba3-e2af3d0a5baf admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:51.814309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec88b-5d09-4087-bba3-e2af3d0a5baf admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:51.819602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec88b-5d09-4087-bba3-e2af3d0a5baf admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:51.821775 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec88b-5d09-4087-bba3-e2af3d0a5baf admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:51.824121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 110/220] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:51 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:51.831489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7e89d-9a5f-4cd1-b958-8a79e33e06f7 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:51.842967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7e89d-9a5f-4cd1-b958-8a79e33e06f7 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:51.848558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da1d4b-5659-4884-8069-7383960be02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:51.849518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da1d4b-5659-4884-8069-7383960be02f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:51.850043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da1d4b-5659-4884-8069-7383960be02f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:51.850569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da1d4b-5659-4884-8069-7383960be02f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:51.851705 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da1d4b-5659-4884-8069-7383960be02f admin admin] RBAC: Adding query filter params (role.id=8f6eaa48bff44ea8822a222e38de2feb, scope.project.id=5f868635149a44f4a2b5cb7811d17563, user.id=7c84bf7add6545f0b6f8356748e2bb9f) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:51.852251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da1d4b-5659-4884-8069-7383960be02f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:51.854369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da1d4b-5659-4884-8069-7383960be02f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:51.863686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 111/221] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:51 2021] GET /identity/v3/role_assignments?user.id=7c84bf7add6545f0b6f8356748e2bb9f&scope.project.id=5f868635149a44f4a2b5cb7811d17563&role.id=8f6eaa48bff44ea8822a222e38de2feb => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:52.035394 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb993983-57f7-4088-8164-859cff8de14e None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:52.035736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb993983-57f7-4088-8164-859cff8de14e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:52.035949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb993983-57f7-4088-8164-859cff8de14e None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:52.038466 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 111/222] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:52.051375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b45475-a90a-4543-8779-01ff836d5244 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:52.051692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b45475-a90a-4543-8779-01ff836d5244 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:52.051930 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b45475-a90a-4543-8779-01ff836d5244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:52.076481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c7b45475-a90a-4543-8779-01ff836d5244 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:52.077753 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c7b45475-a90a-4543-8779-01ff836d5244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:52.089671 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 112/223] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:52.136544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb993983-57f7-4088-8164-859cff8de14e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:52.150863 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb993983-57f7-4088-8164-859cff8de14e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:52.156922 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c1a0-7a87-451f-9a8f-a8d095e7696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:52.157733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c1a0-7a87-451f-9a8f-a8d095e7696d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:52.158090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c1a0-7a87-451f-9a8f-a8d095e7696d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:52.158398 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c1a0-7a87-451f-9a8f-a8d095e7696d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:52.175311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2c1a0-7a87-451f-9a8f-a8d095e7696d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:52.182803 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-70e2c1a0-7a87-451f-9a8f-a8d095e7696d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:17:52.184044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 112/224] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:17:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:52.190575 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b45475-a90a-4543-8779-01ff836d5244 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:52.204848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b45475-a90a-4543-8779-01ff836d5244 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:52.210110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2cc9c-a963-473b-9ae7-71742e1c8a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:52.210780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2cc9c-a963-473b-9ae7-71742e1c8a38 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:52.211056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2cc9c-a963-473b-9ae7-71742e1c8a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:52.211324 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2cc9c-a963-473b-9ae7-71742e1c8a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:52.212078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2cc9c-a963-473b-9ae7-71742e1c8a38 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:52.212379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2cc9c-a963-473b-9ae7-71742e1c8a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:52.213993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2cc9c-a963-473b-9ae7-71742e1c8a38 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:52.223254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 113/225] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:52.229389 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c1a0-7a87-451f-9a8f-a8d095e7696d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:52.243669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c1a0-7a87-451f-9a8f-a8d095e7696d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:52.248387 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce2443-0353-4747-ab30-47230d591561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:52.249277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2443-0353-4747-ab30-47230d591561 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:52.249595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2443-0353-4747-ab30-47230d591561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:52.249959 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2443-0353-4747-ab30-47230d591561 admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:52.251189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce2443-0353-4747-ab30-47230d591561 admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:52.253023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce2443-0353-4747-ab30-47230d591561 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:52.254993 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 113/226] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:52 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:52.261604 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2cc9c-a963-473b-9ae7-71742e1c8a38 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:52.272170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2cc9c-a963-473b-9ae7-71742e1c8a38 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:52.281954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33670248-db7a-4b46-a7dc-84f25d70ceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:52.282617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33670248-db7a-4b46-a7dc-84f25d70ceb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:52.283030 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33670248-db7a-4b46-a7dc-84f25d70ceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:52.283217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33670248-db7a-4b46-a7dc-84f25d70ceb3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:52.292226 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33670248-db7a-4b46-a7dc-84f25d70ceb3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:52.293929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33670248-db7a-4b46-a7dc-84f25d70ceb3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:52.306509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 114/227] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:52.312335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce2443-0353-4747-ab30-47230d591561 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:52.323864 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce2443-0353-4747-ab30-47230d591561 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:52.333584 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56bf80-473d-4ad1-9114-5a278bee033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:52.334685 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56bf80-473d-4ad1-9114-5a278bee033b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:52.334976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56bf80-473d-4ad1-9114-5a278bee033b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:52.335317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56bf80-473d-4ad1-9114-5a278bee033b admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:52.336656 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56bf80-473d-4ad1-9114-5a278bee033b admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:52.338875 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56bf80-473d-4ad1-9114-5a278bee033b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:52.340861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 114/228] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:52 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:52.347452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33670248-db7a-4b46-a7dc-84f25d70ceb3 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:52.356724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33670248-db7a-4b46-a7dc-84f25d70ceb3 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:52.366555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac774dc9-2974-4a58-b9b5-f4f60ea50ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:52.367227 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac774dc9-2974-4a58-b9b5-f4f60ea50ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:52.367507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac774dc9-2974-4a58-b9b5-f4f60ea50ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:52.367780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac774dc9-2974-4a58-b9b5-f4f60ea50ab8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:52.368619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac774dc9-2974-4a58-b9b5-f4f60ea50ab8 admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=5f868635149a44f4a2b5cb7811d17563, user.id=a0f8f7fa57374efdb2df20708faea2ef) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:52.368926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac774dc9-2974-4a58-b9b5-f4f60ea50ab8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:52.370798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac774dc9-2974-4a58-b9b5-f4f60ea50ab8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:52.377650 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 115/229] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:52 2021] GET /identity/v3/role_assignments?user.id=a0f8f7fa57374efdb2df20708faea2ef&scope.project.id=5f868635149a44f4a2b5cb7811d17563&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:52.880228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c42f34-2390-439a-b3fa-7f804b492caa None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:52.881363 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c42f34-2390-439a-b3fa-7f804b492caa None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:52.881363 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c42f34-2390-439a-b3fa-7f804b492caa None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:52.883414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 115/230] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:52.891730 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c08c7-8fad-4422-a81f-30064428a5cf None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:52.891730 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c08c7-8fad-4422-a81f-30064428a5cf None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:52.891730 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c08c7-8fad-4422-a81f-30064428a5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.019975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-a09c08c7-8fad-4422-a81f-30064428a5cf None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:53.021190 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a09c08c7-8fad-4422-a81f-30064428a5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:53.029659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 116/231] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:53.054887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c42f34-2390-439a-b3fa-7f804b492caa None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.076473 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c42f34-2390-439a-b3fa-7f804b492caa None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.083145 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857754e-dbb3-4669-b855-e121bb6c9e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:53.084776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857754e-dbb3-4669-b855-e121bb6c9e98 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.085291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857754e-dbb3-4669-b855-e121bb6c9e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.085804 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857754e-dbb3-4669-b855-e121bb6c9e98 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.104037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857754e-dbb3-4669-b855-e121bb6c9e98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:53.117889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-6857754e-dbb3-4669-b855-e121bb6c9e98 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:17:53.119891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 116/232] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:53.126031 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c08c7-8fad-4422-a81f-30064428a5cf None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.139827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c08c7-8fad-4422-a81f-30064428a5cf None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.149794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47312442-2b97-4a8c-91f8-d4a42a3c0297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:53.150498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312442-2b97-4a8c-91f8-d4a42a3c0297 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.150776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312442-2b97-4a8c-91f8-d4a42a3c0297 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.151046 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312442-2b97-4a8c-91f8-d4a42a3c0297 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.151863 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47312442-2b97-4a8c-91f8-d4a42a3c0297 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:53.152162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47312442-2b97-4a8c-91f8-d4a42a3c0297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:53.153799 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47312442-2b97-4a8c-91f8-d4a42a3c0297 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:53.169422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 117/233] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:53.175552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857754e-dbb3-4669-b855-e121bb6c9e98 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.186307 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857754e-dbb3-4669-b855-e121bb6c9e98 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.193719 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4d8ed-08ad-4c4e-aedb-0466343120a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:53.194982 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4d8ed-08ad-4c4e-aedb-0466343120a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.195494 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4d8ed-08ad-4c4e-aedb-0466343120a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.196021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4d8ed-08ad-4c4e-aedb-0466343120a2 admin admin] PATH_INFO: `/v3/users/7c84bf7add6545f0b6f8356748e2bb9f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.202748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4d8ed-08ad-4c4e-aedb-0466343120a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c84bf7add6545f0b6f8356748e2bb9f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:53.206308 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4d8ed-08ad-4c4e-aedb-0466343120a2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:53.209338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 117/234] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/users/7c84bf7add6545f0b6f8356748e2bb9f => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:53.215527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47312442-2b97-4a8c-91f8-d4a42a3c0297 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.229444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47312442-2b97-4a8c-91f8-d4a42a3c0297 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.235584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4b929-8832-4474-9772-2e87f5786fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:53.236235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b929-8832-4474-9772-2e87f5786fdc admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.236514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b929-8832-4474-9772-2e87f5786fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.236830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b929-8832-4474-9772-2e87f5786fdc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.249566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4b929-8832-4474-9772-2e87f5786fdc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:53.251407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4b929-8832-4474-9772-2e87f5786fdc admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:53.262594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 118/235] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:53.269003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4d8ed-08ad-4c4e-aedb-0466343120a2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.284444 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4d8ed-08ad-4c4e-aedb-0466343120a2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.293469 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e5e13-2ed0-4e0b-9810-0953beb9654f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:53.294649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e5e13-2ed0-4e0b-9810-0953beb9654f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.295161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e5e13-2ed0-4e0b-9810-0953beb9654f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.295690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e5e13-2ed0-4e0b-9810-0953beb9654f admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.303335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e5e13-2ed0-4e0b-9810-0953beb9654f admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:53.305764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e5e13-2ed0-4e0b-9810-0953beb9654f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:53.308042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 118/236] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:53.315408 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4b929-8832-4474-9772-2e87f5786fdc admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.328168 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4b929-8832-4474-9772-2e87f5786fdc admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.335779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbab24a-d273-4fbc-85a6-499ced80838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:53.336441 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbab24a-d273-4fbc-85a6-499ced80838d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.336716 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbab24a-d273-4fbc-85a6-499ced80838d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.337040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbab24a-d273-4fbc-85a6-499ced80838d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.337944 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbab24a-d273-4fbc-85a6-499ced80838d admin admin] RBAC: Adding query filter params (role.id=8f120e43ae5140dbbe6dbdf88980fabe, scope.project.id=5f868635149a44f4a2b5cb7811d17563, user.id=7c84bf7add6545f0b6f8356748e2bb9f) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:53.338306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbab24a-d273-4fbc-85a6-499ced80838d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:53.340183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbab24a-d273-4fbc-85a6-499ced80838d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:53.352362 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 119/237] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/role_assignments?user.id=7c84bf7add6545f0b6f8356748e2bb9f&scope.project.id=5f868635149a44f4a2b5cb7811d17563&role.id=8f120e43ae5140dbbe6dbdf88980fabe => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:53.612453 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143dd7b-460f-418a-a7b5-ddd668e8c1e4 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.613179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143dd7b-460f-418a-a7b5-ddd668e8c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.613666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143dd7b-460f-418a-a7b5-ddd668e8c1e4 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.616288 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 119/238] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:53.622982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d337850-7843-4b2b-83fc-e36660d5f9e2 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.623267 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d337850-7843-4b2b-83fc-e36660d5f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.623543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d337850-7843-4b2b-83fc-e36660d5f9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.647091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-2d337850-7843-4b2b-83fc-e36660d5f9e2 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:53.648333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-2d337850-7843-4b2b-83fc-e36660d5f9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:53.661474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 120/239] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:53.687838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143dd7b-460f-418a-a7b5-ddd668e8c1e4 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.706200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143dd7b-460f-418a-a7b5-ddd668e8c1e4 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.711137 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61080b-4c64-40bd-a0e5-c5eac5fd1fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:53.712160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61080b-4c64-40bd-a0e5-c5eac5fd1fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.712639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61080b-4c64-40bd-a0e5-c5eac5fd1fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.713213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61080b-4c64-40bd-a0e5-c5eac5fd1fd0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.730481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61080b-4c64-40bd-a0e5-c5eac5fd1fd0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:53.738062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-7a61080b-4c64-40bd-a0e5-c5eac5fd1fd0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:53.739681 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 120/240] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:53.747358 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d337850-7843-4b2b-83fc-e36660d5f9e2 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.759760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d337850-7843-4b2b-83fc-e36660d5f9e2 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.768715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48980f3b-ab93-4e16-8e20-6dda61775c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:53.769460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48980f3b-ab93-4e16-8e20-6dda61775c03 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.769744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48980f3b-ab93-4e16-8e20-6dda61775c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.770037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48980f3b-ab93-4e16-8e20-6dda61775c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.770886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48980f3b-ab93-4e16-8e20-6dda61775c03 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:53.771775 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48980f3b-ab93-4e16-8e20-6dda61775c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:53.773676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48980f3b-ab93-4e16-8e20-6dda61775c03 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:53.787777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 121/241] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:53.794619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61080b-4c64-40bd-a0e5-c5eac5fd1fd0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.805135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61080b-4c64-40bd-a0e5-c5eac5fd1fd0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.813752 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbf08b-4f86-4904-8310-e85a2a4a2dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:53.814730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbf08b-4f86-4904-8310-e85a2a4a2dce admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.815209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbf08b-4f86-4904-8310-e85a2a4a2dce admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.815679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbf08b-4f86-4904-8310-e85a2a4a2dce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.825087 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbf08b-4f86-4904-8310-e85a2a4a2dce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:53.827166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbf08b-4f86-4904-8310-e85a2a4a2dce admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:53.840705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 121/242] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:53.846886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48980f3b-ab93-4e16-8e20-6dda61775c03 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.863029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48980f3b-ab93-4e16-8e20-6dda61775c03 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.872855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777a7ff-30a2-47d2-9cfd-a181d17afa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:53.873780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a7ff-30a2-47d2-9cfd-a181d17afa57 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.874103 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a7ff-30a2-47d2-9cfd-a181d17afa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.874378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777a7ff-30a2-47d2-9cfd-a181d17afa57 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.876173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777a7ff-30a2-47d2-9cfd-a181d17afa57 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:53.878357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777a7ff-30a2-47d2-9cfd-a181d17afa57 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:53.880156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 122/243] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:53.886614 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbf08b-4f86-4904-8310-e85a2a4a2dce admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.890611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09352627-d723-4a66-abd3-9309739c7310 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.890899 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09352627-d723-4a66-abd3-9309739c7310 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.891219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09352627-d723-4a66-abd3-9309739c7310 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.893011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 123/244] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:17:53.898608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbf08b-4f86-4904-8310-e85a2a4a2dce admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.899514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c243d2-32c2-469e-8860-9c390a8cf597 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.899830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c243d2-32c2-469e-8860-9c390a8cf597 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.900099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c243d2-32c2-469e-8860-9c390a8cf597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.912628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71479313-c83d-469f-a868-f818f7a0887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:53.914835 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71479313-c83d-469f-a868-f818f7a0887c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.915355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71479313-c83d-469f-a868-f818f7a0887c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.915843 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71479313-c83d-469f-a868-f818f7a0887c admin admin] PATH_INFO: `/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.929751 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-80c243d2-32c2-469e-8860-9c390a8cf597 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:53.930055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-80c243d2-32c2-469e-8860-9c390a8cf597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:53.936069 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71479313-c83d-469f-a868-f818f7a0887c admin admin] RBAC: Authorizing `identity:get_group(group_id=304c6301e1244ad7b1c1b2082c6b7e72)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:53.939448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-71479313-c83d-469f-a868-f818f7a0887c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:53.939448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:17:53.939448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:17:53.939448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71479313-c83d-469f-a868-f818f7a0887c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:53.941196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 122/245] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72 => generated 226 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:53.945086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 124/246] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 14:17:53.957212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71479313-c83d-469f-a868-f818f7a0887c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.972997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71479313-c83d-469f-a868-f818f7a0887c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.976273 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c243d2-32c2-469e-8860-9c390a8cf597 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:53.978559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31256d-e935-4e78-b45f-e6bd5904537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:53.979479 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31256d-e935-4e78-b45f-e6bd5904537f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:53.979998 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31256d-e935-4e78-b45f-e6bd5904537f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:53.980467 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31256d-e935-4e78-b45f-e6bd5904537f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:53.981749 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31256d-e935-4e78-b45f-e6bd5904537f admin admin] RBAC: Adding query filter params (group.id=304c6301e1244ad7b1c1b2082c6b7e72, role.id=8f6eaa48bff44ea8822a222e38de2feb, scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:53.982289 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31256d-e935-4e78-b45f-e6bd5904537f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:53.984350 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31256d-e935-4e78-b45f-e6bd5904537f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:53.993583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c243d2-32c2-469e-8860-9c390a8cf597 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:53.994215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 123/247] 10.222.0.16 () {56 vars in 1398 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/role_assignments?group.id=304c6301e1244ad7b1c1b2082c6b7e72&scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8&role.id=8f6eaa48bff44ea8822a222e38de2feb => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:54.010846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa603a5-2185-4aae-97be-5ae092d9236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:54.011700 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa603a5-2185-4aae-97be-5ae092d9236f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:54.011980 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa603a5-2185-4aae-97be-5ae092d9236f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:54.012252 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa603a5-2185-4aae-97be-5ae092d9236f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:54.039127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa603a5-2185-4aae-97be-5ae092d9236f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:54.046555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-2aa603a5-2185-4aae-97be-5ae092d9236f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:17:54.047824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 125/248] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:17:53 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:54.055133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31256d-e935-4e78-b45f-e6bd5904537f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:54.070647 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31256d-e935-4e78-b45f-e6bd5904537f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:54.075790 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2241c-40b4-4928-a6b4-8cee963d9c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:54.076868 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2241c-40b4-4928-a6b4-8cee963d9c97 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:54.077425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2241c-40b4-4928-a6b4-8cee963d9c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:54.077961 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2241c-40b4-4928-a6b4-8cee963d9c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:54.078976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2241c-40b4-4928-a6b4-8cee963d9c97 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:54.079545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2241c-40b4-4928-a6b4-8cee963d9c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:54.081437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2241c-40b4-4928-a6b4-8cee963d9c97 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:54.096620 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 124/249] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:17:54 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:54.103423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa603a5-2185-4aae-97be-5ae092d9236f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:54.120544 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa603a5-2185-4aae-97be-5ae092d9236f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:54.130583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4f7f0-0494-44d1-8de2-5dc3559df897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:54.131654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4f7f0-0494-44d1-8de2-5dc3559df897 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:54.132071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4f7f0-0494-44d1-8de2-5dc3559df897 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:54.132477 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4f7f0-0494-44d1-8de2-5dc3559df897 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:54.147081 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4f7f0-0494-44d1-8de2-5dc3559df897 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:54.148859 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4f7f0-0494-44d1-8de2-5dc3559df897 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:54.164927 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 126/250] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:54.170773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2241c-40b4-4928-a6b4-8cee963d9c97 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:54.181923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2241c-40b4-4928-a6b4-8cee963d9c97 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:54.192310 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ac79f-218a-46b8-a265-f5c24619bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:54.194193 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ac79f-218a-46b8-a265-f5c24619bcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:54.194589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ac79f-218a-46b8-a265-f5c24619bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:54.194985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ac79f-218a-46b8-a265-f5c24619bcb1 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:54.196492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ac79f-218a-46b8-a265-f5c24619bcb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:54.203480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ac79f-218a-46b8-a265-f5c24619bcb1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:54.206767 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 125/251] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:54 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:54.214505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4f7f0-0494-44d1-8de2-5dc3559df897 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:54.227057 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4f7f0-0494-44d1-8de2-5dc3559df897 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:54.242559 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cd165-f019-4ac6-b8bd-bc4967b183df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:54.243435 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cd165-f019-4ac6-b8bd-bc4967b183df admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:54.243711 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cd165-f019-4ac6-b8bd-bc4967b183df admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:54.243986 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cd165-f019-4ac6-b8bd-bc4967b183df admin admin] PATH_INFO: `/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:54.245203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cd165-f019-4ac6-b8bd-bc4967b183df admin admin] RBAC: Authorizing `identity:get_group(group_id=304c6301e1244ad7b1c1b2082c6b7e72)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:54.246237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-b12cd165-f019-4ac6-b8bd-bc4967b183df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:17:54.246237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:17:54.246237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:17:54.247412 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cd165-f019-4ac6-b8bd-bc4967b183df admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:54.249351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 127/252] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:17:54 2021] GET /identity/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:54.255364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ac79f-218a-46b8-a265-f5c24619bcb1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:54.274673 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ac79f-218a-46b8-a265-f5c24619bcb1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:54.279610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5adb9-6376-4ca8-838b-4f7f4c3bc3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:54.280439 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5adb9-6376-4ca8-838b-4f7f4c3bc3cd admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:54.280825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5adb9-6376-4ca8-838b-4f7f4c3bc3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:54.281206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5adb9-6376-4ca8-838b-4f7f4c3bc3cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:54.282180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5adb9-6376-4ca8-838b-4f7f4c3bc3cd admin admin] RBAC: Adding query filter params (group.id=304c6301e1244ad7b1c1b2082c6b7e72, role.id=8f120e43ae5140dbbe6dbdf88980fabe, scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:54.282598 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5adb9-6376-4ca8-838b-4f7f4c3bc3cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:54.284560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5adb9-6376-4ca8-838b-4f7f4c3bc3cd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:54.295440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 126/253] 10.222.0.16 () {56 vars in 1398 bytes} [Sun Aug 29 14:17:54 2021] GET /identity/v3/role_assignments?group.id=304c6301e1244ad7b1c1b2082c6b7e72&scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8&role.id=8f120e43ae5140dbbe6dbdf88980fabe => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:54.942443 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4a445-29fa-4b8c-a7a6-c38b6186bb5e None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:54.943593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4a445-29fa-4b8c-a7a6-c38b6186bb5e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:54.943593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4a445-29fa-4b8c-a7a6-c38b6186bb5e None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:54.945538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 128/254] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:54.965526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc1de-036d-4816-8ec4-6c073493a605 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:54.966093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc1de-036d-4816-8ec4-6c073493a605 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:54.966093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc1de-036d-4816-8ec4-6c073493a605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:54.990344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-2f6cc1de-036d-4816-8ec4-6c073493a605 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:54.991566 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2f6cc1de-036d-4816-8ec4-6c073493a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:55.006343 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 127/255] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:55.051428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4a445-29fa-4b8c-a7a6-c38b6186bb5e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:55.067774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4a445-29fa-4b8c-a7a6-c38b6186bb5e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:55.077072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e9da2-8e6a-4c31-91d5-033df558e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:55.077885 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e9da2-8e6a-4c31-91d5-033df558e416 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.078153 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e9da2-8e6a-4c31-91d5-033df558e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.078420 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e9da2-8e6a-4c31-91d5-033df558e416 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.099702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e9da2-8e6a-4c31-91d5-033df558e416 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:55.106687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-f01e9da2-8e6a-4c31-91d5-033df558e416 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:55.107912 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 129/256] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:55.114362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cc1de-036d-4816-8ec4-6c073493a605 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:55.129448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cc1de-036d-4816-8ec4-6c073493a605 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:55.142541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66ad1-c48e-4235-8270-90994d85efa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:55.143230 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66ad1-c48e-4235-8270-90994d85efa6 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.143510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66ad1-c48e-4235-8270-90994d85efa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.143781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66ad1-c48e-4235-8270-90994d85efa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.144540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d66ad1-c48e-4235-8270-90994d85efa6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:55.144846 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d66ad1-c48e-4235-8270-90994d85efa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:55.146587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d66ad1-c48e-4235-8270-90994d85efa6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:55.160066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 128/257] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:55.166837 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e9da2-8e6a-4c31-91d5-033df558e416 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:55.176611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e9da2-8e6a-4c31-91d5-033df558e416 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:55.185967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b8596-4aba-4aaf-afbf-205fedb0c177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:55.186627 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b8596-4aba-4aaf-afbf-205fedb0c177 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.186900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b8596-4aba-4aaf-afbf-205fedb0c177 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.187164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b8596-4aba-4aaf-afbf-205fedb0c177 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.203329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b8596-4aba-4aaf-afbf-205fedb0c177 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:55.205041 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b8596-4aba-4aaf-afbf-205fedb0c177 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:55.217090 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 130/258] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:55.223639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66ad1-c48e-4235-8270-90994d85efa6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:55.239699 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66ad1-c48e-4235-8270-90994d85efa6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:55.245606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ce203-7501-43c6-91c5-e0c0cb52a9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:55.250616 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce203-7501-43c6-91c5-e0c0cb52a9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.250931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce203-7501-43c6-91c5-e0c0cb52a9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.251213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce203-7501-43c6-91c5-e0c0cb52a9d3 admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.257649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ce203-7501-43c6-91c5-e0c0cb52a9d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:55.259743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ce203-7501-43c6-91c5-e0c0cb52a9d3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:55.261992 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 129/259] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:55 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:55.267964 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b8596-4aba-4aaf-afbf-205fedb0c177 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:55.277618 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b8596-4aba-4aaf-afbf-205fedb0c177 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:55.288215 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f875a1-5233-44c1-b069-2c01ae070cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:55.289070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f875a1-5233-44c1-b069-2c01ae070cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.289342 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f875a1-5233-44c1-b069-2c01ae070cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.289612 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f875a1-5233-44c1-b069-2c01ae070cc5 admin admin] PATH_INFO: `/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.294593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f875a1-5233-44c1-b069-2c01ae070cc5 admin admin] RBAC: Authorizing `identity:get_group(group_id=304c6301e1244ad7b1c1b2082c6b7e72)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:55.296488 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f875a1-5233-44c1-b069-2c01ae070cc5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:55.298136 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 131/260] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:17:55 2021] GET /identity/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:55.303642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea2c1-4fcf-4200-9d73-25312a3ce4ee None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.304159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea2c1-4fcf-4200-9d73-25312a3ce4ee None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.304441 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea2c1-4fcf-4200-9d73-25312a3ce4ee None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.304835 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f875a1-5233-44c1-b069-2c01ae070cc5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:55.306239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 130/261] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:55.312074 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc9232-0a78-41b7-be07-8a3ec65e5cea None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.312357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc9232-0a78-41b7-be07-8a3ec65e5cea None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.312637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc9232-0a78-41b7-be07-8a3ec65e5cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.315196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f875a1-5233-44c1-b069-2c01ae070cc5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:55.326513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c293d1-5818-4cec-97c0-5d934d7a9fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:55.327166 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c293d1-5818-4cec-97c0-5d934d7a9fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.327441 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c293d1-5818-4cec-97c0-5d934d7a9fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.327712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c293d1-5818-4cec-97c0-5d934d7a9fb9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.328544 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c293d1-5818-4cec-97c0-5d934d7a9fb9 admin admin] RBAC: Adding query filter params (group.id=304c6301e1244ad7b1c1b2082c6b7e72, role.id=8f6eaa48bff44ea8822a222e38de2feb, scope.project.id=5f868635149a44f4a2b5cb7811d17563) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:55.328849 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c293d1-5818-4cec-97c0-5d934d7a9fb9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:55.330689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c293d1-5818-4cec-97c0-5d934d7a9fb9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:55.343567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 132/262] 10.222.0.16 () {56 vars in 1398 bytes} [Sun Aug 29 14:17:55 2021] GET /identity/v3/role_assignments?group.id=304c6301e1244ad7b1c1b2082c6b7e72&scope.project.id=5f868635149a44f4a2b5cb7811d17563&role.id=8f6eaa48bff44ea8822a222e38de2feb => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:55.354308 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-91cc9232-0a78-41b7-be07-8a3ec65e5cea None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:55.355498 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-91cc9232-0a78-41b7-be07-8a3ec65e5cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:55.373792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 131/263] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:55.409926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c293d1-5818-4cec-97c0-5d934d7a9fb9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:55.422932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c293d1-5818-4cec-97c0-5d934d7a9fb9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:55.452483 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc883e-0aaa-45a3-a8dc-657c6dea274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:55.453729 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc883e-0aaa-45a3-a8dc-657c6dea274e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.454264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc883e-0aaa-45a3-a8dc-657c6dea274e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.454752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc883e-0aaa-45a3-a8dc-657c6dea274e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.476082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc883e-0aaa-45a3-a8dc-657c6dea274e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:55.490374 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-15dc883e-0aaa-45a3-a8dc-657c6dea274e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:17:55.492858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 133/264] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:17:55 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:55.499507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc9232-0a78-41b7-be07-8a3ec65e5cea None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:55.520477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc9232-0a78-41b7-be07-8a3ec65e5cea None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:55.538771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d886b6-dd4c-4986-aa66-216bb3abf1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:55.539476 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d886b6-dd4c-4986-aa66-216bb3abf1eb admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.539754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d886b6-dd4c-4986-aa66-216bb3abf1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.540025 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d886b6-dd4c-4986-aa66-216bb3abf1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.540794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d886b6-dd4c-4986-aa66-216bb3abf1eb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:55.541095 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d886b6-dd4c-4986-aa66-216bb3abf1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:55.542780 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d886b6-dd4c-4986-aa66-216bb3abf1eb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:55.558399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 132/265] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:17:55 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:55.564680 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc883e-0aaa-45a3-a8dc-657c6dea274e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:55.579986 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc883e-0aaa-45a3-a8dc-657c6dea274e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:55.601129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474443f0-55af-4a87-8674-c2fa30cb5092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:55.602347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474443f0-55af-4a87-8674-c2fa30cb5092 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.602848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474443f0-55af-4a87-8674-c2fa30cb5092 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.603341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474443f0-55af-4a87-8674-c2fa30cb5092 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.619802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474443f0-55af-4a87-8674-c2fa30cb5092 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:55.621953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474443f0-55af-4a87-8674-c2fa30cb5092 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:55.637349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 134/266] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:55.647891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d886b6-dd4c-4986-aa66-216bb3abf1eb admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:55.676951 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d886b6-dd4c-4986-aa66-216bb3abf1eb admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:55.694990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2764a-80af-4d11-a71d-91946cf290a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:55.696247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2764a-80af-4d11-a71d-91946cf290a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.696751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2764a-80af-4d11-a71d-91946cf290a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.697226 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2764a-80af-4d11-a71d-91946cf290a9 admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.698769 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2764a-80af-4d11-a71d-91946cf290a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:55.701208 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2764a-80af-4d11-a71d-91946cf290a9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:55.703600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 133/267] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:55 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:55.711028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474443f0-55af-4a87-8674-c2fa30cb5092 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:55.723918 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474443f0-55af-4a87-8674-c2fa30cb5092 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:55.738541 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c353-e314-4d06-85a1-357833aefae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:55.739814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c353-e314-4d06-85a1-357833aefae2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.740909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c353-e314-4d06-85a1-357833aefae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.741394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c353-e314-4d06-85a1-357833aefae2 admin admin] PATH_INFO: `/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.742890 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5c353-e314-4d06-85a1-357833aefae2 admin admin] RBAC: Authorizing `identity:get_group(group_id=304c6301e1244ad7b1c1b2082c6b7e72)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:55.745084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5c353-e314-4d06-85a1-357833aefae2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:55.746947 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 135/268] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:17:55 2021] GET /identity/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:55.753576 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2764a-80af-4d11-a71d-91946cf290a9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:55.771758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2764a-80af-4d11-a71d-91946cf290a9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:55.782138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb592103-9b06-474a-a01f-a45b7b36b2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:55.785890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb592103-9b06-474a-a01f-a45b7b36b2dd admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:55.785890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb592103-9b06-474a-a01f-a45b7b36b2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:55.785890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb592103-9b06-474a-a01f-a45b7b36b2dd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:55.785890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb592103-9b06-474a-a01f-a45b7b36b2dd admin admin] RBAC: Adding query filter params (group.id=304c6301e1244ad7b1c1b2082c6b7e72, role.id=8f120e43ae5140dbbe6dbdf88980fabe, scope.project.id=5f868635149a44f4a2b5cb7811d17563) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:55.785890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb592103-9b06-474a-a01f-a45b7b36b2dd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:55.786304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb592103-9b06-474a-a01f-a45b7b36b2dd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:55.795847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 134/269] 10.222.0.16 () {56 vars in 1398 bytes} [Sun Aug 29 14:17:55 2021] GET /identity/v3/role_assignments?group.id=304c6301e1244ad7b1c1b2082c6b7e72&scope.project.id=5f868635149a44f4a2b5cb7811d17563&role.id=8f120e43ae5140dbbe6dbdf88980fabe => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:56.443671 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428117f4-201e-4253-95ae-c25c16306043 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.444182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428117f4-201e-4253-95ae-c25c16306043 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.444292 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428117f4-201e-4253-95ae-c25c16306043 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.446470 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 136/270] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:56.463144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f4f5-8cc3-42f6-bf00-44ef2e296422 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.463144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f4f5-8cc3-42f6-bf00-44ef2e296422 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.463144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f4f5-8cc3-42f6-bf00-44ef2e296422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.486169 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c838f4f5-8cc3-42f6-bf00-44ef2e296422 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:56.487664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c838f4f5-8cc3-42f6-bf00-44ef2e296422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:56.501198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 135/271] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:56.530900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428117f4-201e-4253-95ae-c25c16306043 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:56.547675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428117f4-201e-4253-95ae-c25c16306043 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:56.553185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcf6c7-7ddc-49e8-97ae-ab0ebc0e44f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:56.554347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcf6c7-7ddc-49e8-97ae-ab0ebc0e44f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.554842 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcf6c7-7ddc-49e8-97ae-ab0ebc0e44f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.555314 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcf6c7-7ddc-49e8-97ae-ab0ebc0e44f2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.574968 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcf6c7-7ddc-49e8-97ae-ab0ebc0e44f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:56.582340 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-dddcf6c7-7ddc-49e8-97ae-ab0ebc0e44f2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:17:56.584188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 137/272] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:17:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:56.591015 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f4f5-8cc3-42f6-bf00-44ef2e296422 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:56.604268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f4f5-8cc3-42f6-bf00-44ef2e296422 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:56.609165 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0db65a-927c-458a-ab23-6dee0952850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:56.610184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0db65a-927c-458a-ab23-6dee0952850f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.610658 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0db65a-927c-458a-ab23-6dee0952850f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.611139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0db65a-927c-458a-ab23-6dee0952850f admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.612073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0db65a-927c-458a-ab23-6dee0952850f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:56.612590 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0db65a-927c-458a-ab23-6dee0952850f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:56.614409 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0db65a-927c-458a-ab23-6dee0952850f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:56.629374 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 136/273] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:56.637406 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcf6c7-7ddc-49e8-97ae-ab0ebc0e44f2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:56.647628 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcf6c7-7ddc-49e8-97ae-ab0ebc0e44f2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:56.648931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5faac6-936e-4e6a-8cda-5cf20b1427c5 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.649226 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5faac6-936e-4e6a-8cda-5cf20b1427c5 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.649505 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5faac6-936e-4e6a-8cda-5cf20b1427c5 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.651301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 137/274] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:56.657605 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8a776-1892-4a7a-bffb-299798a5b3fe None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.657913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8a776-1892-4a7a-bffb-299798a5b3fe None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.658197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8a776-1892-4a7a-bffb-299798a5b3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.665981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcf888-b87a-4179-a739-97bde410555a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:56.666646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcf888-b87a-4179-a739-97bde410555a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.666928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcf888-b87a-4179-a739-97bde410555a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.667205 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcf888-b87a-4179-a739-97bde410555a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.680573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcf888-b87a-4179-a739-97bde410555a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:56.682685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcf888-b87a-4179-a739-97bde410555a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:56.685030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-ebf8a776-1892-4a7a-bffb-299798a5b3fe None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:56.686252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ebf8a776-1892-4a7a-bffb-299798a5b3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:56.694675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 138/275] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:56.699851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 138/276] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:17:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:17:56.706105 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8a776-1892-4a7a-bffb-299798a5b3fe None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:56.716310 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8a776-1892-4a7a-bffb-299798a5b3fe None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:56.725357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8f7fb-c809-45ec-81f8-408b5410a54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:56.726256 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8f7fb-c809-45ec-81f8-408b5410a54d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.726599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8f7fb-c809-45ec-81f8-408b5410a54d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.726872 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8f7fb-c809-45ec-81f8-408b5410a54d admin admin] PATH_INFO: `/v3/projects/3ee3fdc9b9a0424b897a4f05d6b3569f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.728137 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8f7fb-c809-45ec-81f8-408b5410a54d admin admin] RBAC: Authorizing `identity:get_project(project_id=3ee3fdc9b9a0424b897a4f05d6b3569f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:56.730202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8f7fb-c809-45ec-81f8-408b5410a54d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:56.731971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 139/277] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:56 2021] GET /identity/v3/projects/3ee3fdc9b9a0424b897a4f05d6b3569f => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:56.738303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcf888-b87a-4179-a739-97bde410555a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:56.750461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8f7fb-c809-45ec-81f8-408b5410a54d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:56.755807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcf888-b87a-4179-a739-97bde410555a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:56.764343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a7dbb-cda9-4322-88ad-d4d806fee13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:56.767091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a7dbb-cda9-4322-88ad-d4d806fee13e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.767386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a7dbb-cda9-4322-88ad-d4d806fee13e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.767673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a7dbb-cda9-4322-88ad-d4d806fee13e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.774859 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8f7fb-c809-45ec-81f8-408b5410a54d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:56.783981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c4fce-0b29-42b8-b7a2-bf0151843415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:56.787287 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c4fce-0b29-42b8-b7a2-bf0151843415 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.787593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c4fce-0b29-42b8-b7a2-bf0151843415 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.787871 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c4fce-0b29-42b8-b7a2-bf0151843415 admin admin] PATH_INFO: `/v3/groups/7562e07653444c798c6efed6be73ff35` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.791677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a7dbb-cda9-4322-88ad-d4d806fee13e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:56.797356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c4fce-0b29-42b8-b7a2-bf0151843415 admin admin] RBAC: Authorizing `identity:get_group(group_id=7562e07653444c798c6efed6be73ff35)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:56.799429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c4fce-0b29-42b8-b7a2-bf0151843415 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:56.800369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-274a7dbb-cda9-4322-88ad-d4d806fee13e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:56.801164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 140/278] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:17:56 2021] GET /identity/v3/groups/7562e07653444c798c6efed6be73ff35 => generated 229 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:56.802074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 139/279] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:56 2021] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:17:56.807584 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c4fce-0b29-42b8-b7a2-bf0151843415 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:56.817728 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c4fce-0b29-42b8-b7a2-bf0151843415 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:56.819383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a7dbb-cda9-4322-88ad-d4d806fee13e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:56.822983 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483b63c-c2a6-4088-b130-45de47e0f52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:56.823642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483b63c-c2a6-4088-b130-45de47e0f52e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.823927 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483b63c-c2a6-4088-b130-45de47e0f52e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.824204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483b63c-c2a6-4088-b130-45de47e0f52e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.825035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483b63c-c2a6-4088-b130-45de47e0f52e admin admin] RBAC: Adding query filter params (group.id=7562e07653444c798c6efed6be73ff35, role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=3ee3fdc9b9a0424b897a4f05d6b3569f) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:56.825447 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483b63c-c2a6-4088-b130-45de47e0f52e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:56.827326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483b63c-c2a6-4088-b130-45de47e0f52e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:56.836002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 141/280] 10.222.0.16 () {56 vars in 1398 bytes} [Sun Aug 29 14:17:56 2021] GET /identity/v3/role_assignments?group.id=7562e07653444c798c6efed6be73ff35&scope.project.id=3ee3fdc9b9a0424b897a4f05d6b3569f&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:56.839432 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a7dbb-cda9-4322-88ad-d4d806fee13e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:56.847912 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19d7b4-3e1e-4aba-b114-977501f6c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:56.848617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19d7b4-3e1e-4aba-b114-977501f6c9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.848900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19d7b4-3e1e-4aba-b114-977501f6c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.849989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19d7b4-3e1e-4aba-b114-977501f6c9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.851306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19d7b4-3e1e-4aba-b114-977501f6c9e7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:56.851621 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19d7b4-3e1e-4aba-b114-977501f6c9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:56.853252 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19d7b4-3e1e-4aba-b114-977501f6c9e7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:56.869074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 140/281] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:56 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:56.875852 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483b63c-c2a6-4088-b130-45de47e0f52e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:56.890662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483b63c-c2a6-4088-b130-45de47e0f52e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:56.900678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd936db-28e5-4e57-b0ad-bbe18e353b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:56.901603 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd936db-28e5-4e57-b0ad-bbe18e353b7a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.901914 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd936db-28e5-4e57-b0ad-bbe18e353b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.902195 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd936db-28e5-4e57-b0ad-bbe18e353b7a admin admin] PATH_INFO: `/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.903423 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd936db-28e5-4e57-b0ad-bbe18e353b7a admin admin] RBAC: Authorizing `identity:get_group(group_id=304c6301e1244ad7b1c1b2082c6b7e72)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:56.905388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd936db-28e5-4e57-b0ad-bbe18e353b7a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:56.907453 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 142/282] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:17:56 2021] GET /identity/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:56.914262 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19d7b4-3e1e-4aba-b114-977501f6c9e7 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:56.928759 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19d7b4-3e1e-4aba-b114-977501f6c9e7 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:56.935846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909411fd-b309-45e2-a7a3-6d22a13f6a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:56.936748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909411fd-b309-45e2-a7a3-6d22a13f6a31 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.937033 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909411fd-b309-45e2-a7a3-6d22a13f6a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.937393 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909411fd-b309-45e2-a7a3-6d22a13f6a31 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.943007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909411fd-b309-45e2-a7a3-6d22a13f6a31 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:56.945853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909411fd-b309-45e2-a7a3-6d22a13f6a31 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:56.947712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 141/283] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:56 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:56.955728 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd936db-28e5-4e57-b0ad-bbe18e353b7a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:56.970226 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd936db-28e5-4e57-b0ad-bbe18e353b7a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:56.979525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35364ac8-962e-4bf5-b3ca-2beaabe20f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:56.980661 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364ac8-962e-4bf5-b3ca-2beaabe20f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:56.980949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364ac8-962e-4bf5-b3ca-2beaabe20f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:56.981276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364ac8-962e-4bf5-b3ca-2beaabe20f44 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8/groups/304c6301e1244ad7b1c1b2082c6b7e72/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:56.984035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35364ac8-962e-4bf5-b3ca-2beaabe20f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a54648acdde4ad6bf01c13ca38c04a8, group_id=304c6301e1244ad7b1c1b2082c6b7e72, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:56.986829 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35364ac8-962e-4bf5-b3ca-2beaabe20f44 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:57.057593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 143/284] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Aug 29 14:17:56 2021] PUT /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8/groups/304c6301e1244ad7b1c1b2082c6b7e72/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:17:57.405925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351c866-1cbb-4eca-8924-7855f23b0655 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:57.406308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351c866-1cbb-4eca-8924-7855f23b0655 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:57.406508 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351c866-1cbb-4eca-8924-7855f23b0655 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:57.408569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 142/285] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:57.415200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68de8e-3034-4d46-a762-024f391e0780 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:57.415489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68de8e-3034-4d46-a762-024f391e0780 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:57.415765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68de8e-3034-4d46-a762-024f391e0780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:57.442956 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3d68de8e-3034-4d46-a762-024f391e0780 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:57.444222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3d68de8e-3034-4d46-a762-024f391e0780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:57.520157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 144/286] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:57.568570 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351c866-1cbb-4eca-8924-7855f23b0655 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:57.591278 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351c866-1cbb-4eca-8924-7855f23b0655 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:57.602351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092af4d-748a-4fc0-a9f9-68fc4f4d385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:57.603156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092af4d-748a-4fc0-a9f9-68fc4f4d385d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:57.603432 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092af4d-748a-4fc0-a9f9-68fc4f4d385d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:57.603703 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092af4d-748a-4fc0-a9f9-68fc4f4d385d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:57.622851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092af4d-748a-4fc0-a9f9-68fc4f4d385d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:57.630503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-d092af4d-748a-4fc0-a9f9-68fc4f4d385d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:17:57.631937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 143/287] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:17:57 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:57.638296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68de8e-3034-4d46-a762-024f391e0780 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:57.652051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68de8e-3034-4d46-a762-024f391e0780 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:57.663056 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689c05b-bb05-4706-9814-022289c979f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:57.663681 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689c05b-bb05-4706-9814-022289c979f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:57.663943 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689c05b-bb05-4706-9814-022289c979f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:57.664219 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689c05b-bb05-4706-9814-022289c979f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:57.664974 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689c05b-bb05-4706-9814-022289c979f6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:57.665279 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689c05b-bb05-4706-9814-022289c979f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:57.666927 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689c05b-bb05-4706-9814-022289c979f6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:57.685165 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 145/288] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:17:57 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:57.690945 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092af4d-748a-4fc0-a9f9-68fc4f4d385d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:57.701634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092af4d-748a-4fc0-a9f9-68fc4f4d385d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:57.712490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090c783-5b74-42bb-8068-897ec07fb316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:57.713348 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090c783-5b74-42bb-8068-897ec07fb316 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:57.713619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090c783-5b74-42bb-8068-897ec07fb316 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:57.713907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090c783-5b74-42bb-8068-897ec07fb316 admin admin] PATH_INFO: `/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:57.715128 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090c783-5b74-42bb-8068-897ec07fb316 admin admin] RBAC: Authorizing `identity:get_group(group_id=304c6301e1244ad7b1c1b2082c6b7e72)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:57.717020 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090c783-5b74-42bb-8068-897ec07fb316 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:57.718939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 144/289] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:17:57 2021] GET /identity/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:57.725142 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689c05b-bb05-4706-9814-022289c979f6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:57.739058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689c05b-bb05-4706-9814-022289c979f6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:57.749871 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea02714-2ce3-45e9-ae1d-1fe106d2ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:57.750735 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea02714-2ce3-45e9-ae1d-1fe106d2ae00 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:57.751017 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea02714-2ce3-45e9-ae1d-1fe106d2ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:57.751292 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea02714-2ce3-45e9-ae1d-1fe106d2ae00 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:57.753271 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea02714-2ce3-45e9-ae1d-1fe106d2ae00 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:57.755986 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea02714-2ce3-45e9-ae1d-1fe106d2ae00 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:57.757776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 146/290] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:57 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:57.764203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090c783-5b74-42bb-8068-897ec07fb316 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:57.774827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090c783-5b74-42bb-8068-897ec07fb316 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:57.785952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfac4d-4824-4d8d-b009-d1c9e868e7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:57.786869 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfac4d-4824-4d8d-b009-d1c9e868e7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:57.787226 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfac4d-4824-4d8d-b009-d1c9e868e7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:57.787411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfac4d-4824-4d8d-b009-d1c9e868e7b5 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8/groups/304c6301e1244ad7b1c1b2082c6b7e72/roles/8f120e43ae5140dbbe6dbdf88980fabe` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:57.795655 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfac4d-4824-4d8d-b009-d1c9e868e7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a54648acdde4ad6bf01c13ca38c04a8, group_id=304c6301e1244ad7b1c1b2082c6b7e72, role_id=8f120e43ae5140dbbe6dbdf88980fabe)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:57.798290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfac4d-4824-4d8d-b009-d1c9e868e7b5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:57.865606 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 145/291] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Aug 29 14:17:57 2021] PUT /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8/groups/304c6301e1244ad7b1c1b2082c6b7e72/roles/8f120e43ae5140dbbe6dbdf88980fabe => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:17:58.808795 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71030a7f-a008-40d5-ac99-d83ba1f6d718 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:58.809495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71030a7f-a008-40d5-ac99-d83ba1f6d718 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:58.809495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71030a7f-a008-40d5-ac99-d83ba1f6d718 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:58.811397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 147/292] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:58.818218 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfaaef-879a-4fba-964c-c7fb5a758dfb None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:58.819459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfaaef-879a-4fba-964c-c7fb5a758dfb None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:58.819459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfaaef-879a-4fba-964c-c7fb5a758dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:58.846889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-4adfaaef-879a-4fba-964c-c7fb5a758dfb None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:58.848104 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4adfaaef-879a-4fba-964c-c7fb5a758dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:58.919972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 146/293] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:58.920189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a295b-12d7-49a6-bb23-0c3a8ef35087 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:58.920189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a295b-12d7-49a6-bb23-0c3a8ef35087 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:58.920189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a295b-12d7-49a6-bb23-0c3a8ef35087 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:58.921452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 148/294] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:58.927206 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e6089-9fcf-42a3-80f2-40863ed26073 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:58.927986 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e6089-9fcf-42a3-80f2-40863ed26073 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:58.927986 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e6089-9fcf-42a3-80f2-40863ed26073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:58.959598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-729e6089-9fcf-42a3-80f2-40863ed26073 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:58.960813 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-729e6089-9fcf-42a3-80f2-40863ed26073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:58.970430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a295b-12d7-49a6-bb23-0c3a8ef35087 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:58.970607 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 147/295] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:17:58.997000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e6089-9fcf-42a3-80f2-40863ed26073 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:59.002532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a295b-12d7-49a6-bb23-0c3a8ef35087 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:59.007646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e6089-9fcf-42a3-80f2-40863ed26073 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:59.014592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002504d1-19cc-4b26-a03c-dea17a21f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:59.015424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002504d1-19cc-4b26-a03c-dea17a21f4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.015705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002504d1-19cc-4b26-a03c-dea17a21f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.015981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002504d1-19cc-4b26-a03c-dea17a21f4b1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.017236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c2ace-48f8-492a-9459-d1a9d24bc1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:59.018064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2ace-48f8-492a-9459-d1a9d24bc1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.018348 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2ace-48f8-492a-9459-d1a9d24bc1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.018621 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2ace-48f8-492a-9459-d1a9d24bc1f5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.036445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002504d1-19cc-4b26-a03c-dea17a21f4b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:59.044302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-002504d1-19cc-4b26-a03c-dea17a21f4b1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:17:59.046782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c2ace-48f8-492a-9459-d1a9d24bc1f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:17:59.046904 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 149/296] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:17:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:17:59.054364 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-738c2ace-48f8-492a-9459-d1a9d24bc1f5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:17:59.055169 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002504d1-19cc-4b26-a03c-dea17a21f4b1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:59.055703 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 148/297] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:17:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:17:59.068908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c2ace-48f8-492a-9459-d1a9d24bc1f5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:59.078858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002504d1-19cc-4b26-a03c-dea17a21f4b1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:59.085470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefccee-8a31-44dd-b4cb-d75fc7d1c4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:59.086203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefccee-8a31-44dd-b4cb-d75fc7d1c4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.086485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefccee-8a31-44dd-b4cb-d75fc7d1c4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.086770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefccee-8a31-44dd-b4cb-d75fc7d1c4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.087502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefccee-8a31-44dd-b4cb-d75fc7d1c4c3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:59.087807 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefccee-8a31-44dd-b4cb-d75fc7d1c4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:59.089403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefccee-8a31-44dd-b4cb-d75fc7d1c4c3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:59.092926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c2ace-48f8-492a-9459-d1a9d24bc1f5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:59.103137 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d91fc-22aa-4935-b9ad-f58ba1d65d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:59.103819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d91fc-22aa-4935-b9ad-f58ba1d65d12 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.104102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d91fc-22aa-4935-b9ad-f58ba1d65d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.104379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d91fc-22aa-4935-b9ad-f58ba1d65d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.105134 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d91fc-22aa-4935-b9ad-f58ba1d65d12 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:17:59.105449 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d91fc-22aa-4935-b9ad-f58ba1d65d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:59.107084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d91fc-22aa-4935-b9ad-f58ba1d65d12 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:59.110738 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 150/298] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:17:59 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:59.122925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefccee-8a31-44dd-b4cb-d75fc7d1c4c3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:59.123245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 149/299] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:17:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:59.134916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d91fc-22aa-4935-b9ad-f58ba1d65d12 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:59.137399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefccee-8a31-44dd-b4cb-d75fc7d1c4c3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:59.151178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c607fac-8df8-49fe-9605-2bfb04554768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:59.152749 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d91fc-22aa-4935-b9ad-f58ba1d65d12 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:59.153445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c607fac-8df8-49fe-9605-2bfb04554768 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.153733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c607fac-8df8-49fe-9605-2bfb04554768 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.154389 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c607fac-8df8-49fe-9605-2bfb04554768 admin admin] PATH_INFO: `/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.156344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c607fac-8df8-49fe-9605-2bfb04554768 admin admin] RBAC: Authorizing `identity:get_group(group_id=304c6301e1244ad7b1c1b2082c6b7e72)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:59.159717 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c607fac-8df8-49fe-9605-2bfb04554768 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:59.163011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 151/300] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:17:59 2021] GET /identity/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:59.164148 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff531c-45c9-462f-b54a-75dc903642fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:59.165159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff531c-45c9-462f-b54a-75dc903642fd admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.165445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff531c-45c9-462f-b54a-75dc903642fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.165724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff531c-45c9-462f-b54a-75dc903642fd admin admin] PATH_INFO: `/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.167006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff531c-45c9-462f-b54a-75dc903642fd admin admin] RBAC: Authorizing `identity:get_group(group_id=304c6301e1244ad7b1c1b2082c6b7e72)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:59.169790 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c607fac-8df8-49fe-9605-2bfb04554768 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:59.170361 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff531c-45c9-462f-b54a-75dc903642fd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:59.172385 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 150/301] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:17:59 2021] GET /identity/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:17:59.180196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff531c-45c9-462f-b54a-75dc903642fd admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:59.188727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c607fac-8df8-49fe-9605-2bfb04554768 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:59.196775 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff531c-45c9-462f-b54a-75dc903642fd admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:59.199809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61536f4c-7851-496d-aada-e174cfe62cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:59.200733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61536f4c-7851-496d-aada-e174cfe62cbe admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.201018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61536f4c-7851-496d-aada-e174cfe62cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.201297 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61536f4c-7851-496d-aada-e174cfe62cbe admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.204330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61536f4c-7851-496d-aada-e174cfe62cbe admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:59.207826 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d5b6e-0c10-4906-8599-908a7881d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:59.209427 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d5b6e-0c10-4906-8599-908a7881d63f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.210018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61536f4c-7851-496d-aada-e174cfe62cbe admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:59.212290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d5b6e-0c10-4906-8599-908a7881d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.212290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d5b6e-0c10-4906-8599-908a7881d63f admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.213617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d5b6e-0c10-4906-8599-908a7881d63f admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:59.214411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 152/302] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:59 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:59.215974 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d5b6e-0c10-4906-8599-908a7881d63f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:59.217949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61536f4c-7851-496d-aada-e174cfe62cbe admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:59.222670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 151/303] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:17:59 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:17:59.228755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d5b6e-0c10-4906-8599-908a7881d63f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:17:59.236056 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61536f4c-7851-496d-aada-e174cfe62cbe admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:59.245433 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d5b6e-0c10-4906-8599-908a7881d63f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:17:59.248977 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddc270-d62f-4b51-a70c-a84137b1609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:59.250298 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc270-d62f-4b51-a70c-a84137b1609c admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.250645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc270-d62f-4b51-a70c-a84137b1609c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.250925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc270-d62f-4b51-a70c-a84137b1609c admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563/groups/304c6301e1244ad7b1c1b2082c6b7e72/roles/8f120e43ae5140dbbe6dbdf88980fabe` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.255223 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddc270-d62f-4b51-a70c-a84137b1609c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f868635149a44f4a2b5cb7811d17563, group_id=304c6301e1244ad7b1c1b2082c6b7e72, role_id=8f120e43ae5140dbbe6dbdf88980fabe)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:59.259069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a8578-8fd3-4ccb-bf4b-ce5f4fdb0c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:17:59.259999 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a8578-8fd3-4ccb-bf4b-ce5f4fdb0c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.261734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a8578-8fd3-4ccb-bf4b-ce5f4fdb0c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.262375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddc270-d62f-4b51-a70c-a84137b1609c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:59.263630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a8578-8fd3-4ccb-bf4b-ce5f4fdb0c15 admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563/groups/304c6301e1244ad7b1c1b2082c6b7e72/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.267995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a8578-8fd3-4ccb-bf4b-ce5f4fdb0c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f868635149a44f4a2b5cb7811d17563, group_id=304c6301e1244ad7b1c1b2082c6b7e72, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:17:59.272127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a8578-8fd3-4ccb-bf4b-ce5f4fdb0c15 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:17:59.354186 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 153/304] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Aug 29 14:17:59 2021] PUT /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563/groups/304c6301e1244ad7b1c1b2082c6b7e72/roles/8f120e43ae5140dbbe6dbdf88980fabe => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:17:59.385834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 152/305] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Aug 29 14:17:59 2021] PUT /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563/groups/304c6301e1244ad7b1c1b2082c6b7e72/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:17:59.843951 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a63284-9f24-4dbb-b505-893530a64168 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.844664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a63284-9f24-4dbb-b505-893530a64168 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.844664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a63284-9f24-4dbb-b505-893530a64168 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.846327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 154/306] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:59.850051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a809-18ce-4f45-8afd-19379554c97e None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.850555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a809-18ce-4f45-8afd-19379554c97e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.850732 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a809-18ce-4f45-8afd-19379554c97e None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.852139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adde75f-a7d0-499b-8182-107e9ac185d4 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.852422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adde75f-a7d0-499b-8182-107e9ac185d4 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.852699 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adde75f-a7d0-499b-8182-107e9ac185d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.856056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 153/307] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:17:59 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:17:59.874765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-6adde75f-a7d0-499b-8182-107e9ac185d4 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:59.875958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-6adde75f-a7d0-499b-8182-107e9ac185d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:59.882418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660e588-ec5f-4abc-ab19-41eeda87788e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:17:59.882700 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660e588-ec5f-4abc-ab19-41eeda87788e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:17:59.882980 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660e588-ec5f-4abc-ab19-41eeda87788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:17:59.904888 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-d660e588-ec5f-4abc-ab19-41eeda87788e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:17:59.906128 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d660e588-ec5f-4abc-ab19-41eeda87788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:17:59.973899 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 154/308] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:17:59.983406 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 155/309] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:17:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:00.009549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660e588-ec5f-4abc-ab19-41eeda87788e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.020496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adde75f-a7d0-499b-8182-107e9ac185d4 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.021481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660e588-ec5f-4abc-ab19-41eeda87788e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.032494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b13b7-a4cc-462b-92d9-10b7b32092da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.033396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b13b7-a4cc-462b-92d9-10b7b32092da admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.033681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b13b7-a4cc-462b-92d9-10b7b32092da admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.033977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b13b7-a4cc-462b-92d9-10b7b32092da admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.042671 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adde75f-a7d0-499b-8182-107e9ac185d4 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.051096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6058b-943c-4198-a031-84c28db7450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.053185 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6058b-943c-4198-a031-84c28db7450d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.053445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6058b-943c-4198-a031-84c28db7450d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.053721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6058b-943c-4198-a031-84c28db7450d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.057936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b13b7-a4cc-462b-92d9-10b7b32092da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:00.068911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-132b13b7-a4cc-462b-92d9-10b7b32092da admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:18:00.072097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 155/310] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:00.078972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6058b-943c-4198-a031-84c28db7450d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:00.086092 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-38f6058b-943c-4198-a031-84c28db7450d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:18:00.087308 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 156/311] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:00.090565 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b13b7-a4cc-462b-92d9-10b7b32092da admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.093910 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6058b-943c-4198-a031-84c28db7450d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.100858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b13b7-a4cc-462b-92d9-10b7b32092da admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.106692 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6058b-943c-4198-a031-84c28db7450d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.111325 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62bd28-5c81-4401-a22c-587dcfc30284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.112673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62bd28-5c81-4401-a22c-587dcfc30284 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.113580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62bd28-5c81-4401-a22c-587dcfc30284 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.114957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62bd28-5c81-4401-a22c-587dcfc30284 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.116469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62bd28-5c81-4401-a22c-587dcfc30284 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:00.117194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217ee8d-8d44-43cd-986e-279dabda6b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.118113 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217ee8d-8d44-43cd-986e-279dabda6b56 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.118618 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217ee8d-8d44-43cd-986e-279dabda6b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.119094 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217ee8d-8d44-43cd-986e-279dabda6b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.119602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62bd28-5c81-4401-a22c-587dcfc30284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.120548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217ee8d-8d44-43cd-986e-279dabda6b56 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:00.122383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62bd28-5c81-4401-a22c-587dcfc30284 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.122928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217ee8d-8d44-43cd-986e-279dabda6b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.124716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217ee8d-8d44-43cd-986e-279dabda6b56 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.141690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 157/312] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:00.143796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 156/313] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:00.149901 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217ee8d-8d44-43cd-986e-279dabda6b56 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.153418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62bd28-5c81-4401-a22c-587dcfc30284 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.168197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217ee8d-8d44-43cd-986e-279dabda6b56 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.171299 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62bd28-5c81-4401-a22c-587dcfc30284 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.176405 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae85c61-0732-4a6b-9091-d3925bf03e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.178714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae85c61-0732-4a6b-9091-d3925bf03e2a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.179520 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae85c61-0732-4a6b-9091-d3925bf03e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.179806 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae85c61-0732-4a6b-9091-d3925bf03e2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.181813 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58c55b-ded6-4861-9afe-bc3925838293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.183046 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58c55b-ded6-4861-9afe-bc3925838293 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.184726 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58c55b-ded6-4861-9afe-bc3925838293 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.188458 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58c55b-ded6-4861-9afe-bc3925838293 admin admin] PATH_INFO: `/v3/groups/7562e07653444c798c6efed6be73ff35` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.188458 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58c55b-ded6-4861-9afe-bc3925838293 admin admin] RBAC: Authorizing `identity:get_group(group_id=7562e07653444c798c6efed6be73ff35)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.192460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58c55b-ded6-4861-9afe-bc3925838293 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.195111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 157/314] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/groups/7562e07653444c798c6efed6be73ff35 => generated 229 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:00.196862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae85c61-0732-4a6b-9091-d3925bf03e2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.198709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae85c61-0732-4a6b-9091-d3925bf03e2a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.201448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58c55b-ded6-4861-9afe-bc3925838293 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.215274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58c55b-ded6-4861-9afe-bc3925838293 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.221150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 158/315] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:00.228512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91631a30-ec4d-4989-9006-3b7e6b7a4b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.229442 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91631a30-ec4d-4989-9006-3b7e6b7a4b50 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.229728 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91631a30-ec4d-4989-9006-3b7e6b7a4b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.230124 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91631a30-ec4d-4989-9006-3b7e6b7a4b50 admin admin] PATH_INFO: `/v3/projects/3ee3fdc9b9a0424b897a4f05d6b3569f` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.231658 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91631a30-ec4d-4989-9006-3b7e6b7a4b50 admin admin] RBAC: Authorizing `identity:get_project(project_id=3ee3fdc9b9a0424b897a4f05d6b3569f)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.233618 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91631a30-ec4d-4989-9006-3b7e6b7a4b50 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.235423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 158/316] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/projects/3ee3fdc9b9a0424b897a4f05d6b3569f => generated 344 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:00.237887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae85c61-0732-4a6b-9091-d3925bf03e2a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.250861 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91631a30-ec4d-4989-9006-3b7e6b7a4b50 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.252220 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae85c61-0732-4a6b-9091-d3925bf03e2a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.257825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274aa4d-b945-4047-ab13-713e33eed44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.258805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274aa4d-b945-4047-ab13-713e33eed44b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.259090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274aa4d-b945-4047-ab13-713e33eed44b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.259421 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274aa4d-b945-4047-ab13-713e33eed44b admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.260911 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274aa4d-b945-4047-ab13-713e33eed44b admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.263899 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274aa4d-b945-4047-ab13-713e33eed44b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.265841 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 159/317] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:00.272807 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274aa4d-b945-4047-ab13-713e33eed44b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.273035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91631a30-ec4d-4989-9006-3b7e6b7a4b50 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.283414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274aa4d-b945-4047-ab13-713e33eed44b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.287485 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda489ca-1c80-472d-9307-a68df8b7c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.288367 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda489ca-1c80-472d-9307-a68df8b7c435 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.288571 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d5162-4566-4310-8821-75cb5d816c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.288750 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda489ca-1c80-472d-9307-a68df8b7c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.288916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda489ca-1c80-472d-9307-a68df8b7c435 admin admin] PATH_INFO: `/v3/projects/3ee3fdc9b9a0424b897a4f05d6b3569f/groups/7562e07653444c798c6efed6be73ff35/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.289221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d5162-4566-4310-8821-75cb5d816c04 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.289566 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d5162-4566-4310-8821-75cb5d816c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.290005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d5162-4566-4310-8821-75cb5d816c04 admin admin] PATH_INFO: `/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.291215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d5162-4566-4310-8821-75cb5d816c04 admin admin] RBAC: Authorizing `identity:get_group(group_id=304c6301e1244ad7b1c1b2082c6b7e72)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.293321 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d5162-4566-4310-8821-75cb5d816c04 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.295163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda489ca-1c80-472d-9307-a68df8b7c435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee3fdc9b9a0424b897a4f05d6b3569f, group_id=7562e07653444c798c6efed6be73ff35, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.295477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 160/318] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:00.297837 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda489ca-1c80-472d-9307-a68df8b7c435 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.302089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d5162-4566-4310-8821-75cb5d816c04 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.312709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d5162-4566-4310-8821-75cb5d816c04 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.318284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8065f5-f5fe-4651-a7fc-d8e423adbc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.321854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8065f5-f5fe-4651-a7fc-d8e423adbc95 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.321854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8065f5-f5fe-4651-a7fc-d8e423adbc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.321854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8065f5-f5fe-4651-a7fc-d8e423adbc95 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.321854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8065f5-f5fe-4651-a7fc-d8e423adbc95 admin admin] RBAC: Adding query filter params (group.id=304c6301e1244ad7b1c1b2082c6b7e72, role.id=8f6eaa48bff44ea8822a222e38de2feb, scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:00.321854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8065f5-f5fe-4651-a7fc-d8e423adbc95 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.323067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8065f5-f5fe-4651-a7fc-d8e423adbc95 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.329841 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 161/319] 10.222.0.16 () {56 vars in 1398 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/role_assignments?group.id=304c6301e1244ad7b1c1b2082c6b7e72&scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8&role.id=8f6eaa48bff44ea8822a222e38de2feb => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:00.395040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 159/320] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Aug 29 14:18:00 2021] PUT /identity/v3/projects/3ee3fdc9b9a0424b897a4f05d6b3569f/groups/7562e07653444c798c6efed6be73ff35/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:18:00.613917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386f53b-a8b2-42df-bfc9-52d354b69947 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.613917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386f53b-a8b2-42df-bfc9-52d354b69947 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.613917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386f53b-a8b2-42df-bfc9-52d354b69947 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.615358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 162/321] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:00.621998 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd5d4c-f3d8-4db2-8d24-144e8026338c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.622647 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd5d4c-f3d8-4db2-8d24-144e8026338c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.623171 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd5d4c-f3d8-4db2-8d24-144e8026338c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.651892 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-54bd5d4c-f3d8-4db2-8d24-144e8026338c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:00.653345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-54bd5d4c-f3d8-4db2-8d24-144e8026338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:00.713322 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 160/322] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:00.738535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386f53b-a8b2-42df-bfc9-52d354b69947 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.751925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386f53b-a8b2-42df-bfc9-52d354b69947 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.757305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fcd72-def2-418a-a409-c10e317cc304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.758312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fcd72-def2-418a-a409-c10e317cc304 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.758741 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fcd72-def2-418a-a409-c10e317cc304 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.759158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fcd72-def2-418a-a409-c10e317cc304 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.770556 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fcd72-def2-418a-a409-c10e317cc304 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:00.778697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-3b1fcd72-def2-418a-a409-c10e317cc304 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:18:00.780089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 163/323] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:00.787278 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd5d4c-f3d8-4db2-8d24-144e8026338c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.796623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd5d4c-f3d8-4db2-8d24-144e8026338c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.801474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a57156-bdf3-42fe-9023-231f70e8abf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.802471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a57156-bdf3-42fe-9023-231f70e8abf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.802969 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a57156-bdf3-42fe-9023-231f70e8abf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.803453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a57156-bdf3-42fe-9023-231f70e8abf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.804412 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a57156-bdf3-42fe-9023-231f70e8abf7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:00.804942 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a57156-bdf3-42fe-9023-231f70e8abf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.806763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a57156-bdf3-42fe-9023-231f70e8abf7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.815968 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 161/324] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:00.822655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fcd72-def2-418a-a409-c10e317cc304 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.836679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fcd72-def2-418a-a409-c10e317cc304 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.844341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23bae6-179b-48fb-8927-f805db1a6ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.845009 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23bae6-179b-48fb-8927-f805db1a6ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.845273 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23bae6-179b-48fb-8927-f805db1a6ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.845542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23bae6-179b-48fb-8927-f805db1a6ba2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.855845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23bae6-179b-48fb-8927-f805db1a6ba2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.857608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23bae6-179b-48fb-8927-f805db1a6ba2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.869144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 164/325] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:00.875536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a57156-bdf3-42fe-9023-231f70e8abf7 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.891310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a57156-bdf3-42fe-9023-231f70e8abf7 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.899318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214ea84-fbb6-462a-836c-fa2f3ee5903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.900455 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214ea84-fbb6-462a-836c-fa2f3ee5903e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.900949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214ea84-fbb6-462a-836c-fa2f3ee5903e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.901463 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214ea84-fbb6-462a-836c-fa2f3ee5903e admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.903228 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214ea84-fbb6-462a-836c-fa2f3ee5903e admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.905492 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214ea84-fbb6-462a-836c-fa2f3ee5903e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.907448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 162/326] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:00.915153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23bae6-179b-48fb-8927-f805db1a6ba2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.927028 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23bae6-179b-48fb-8927-f805db1a6ba2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.932710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796ecc9-ff02-4a13-a7d4-0db0df8d399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.939545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796ecc9-ff02-4a13-a7d4-0db0df8d399f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.939545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796ecc9-ff02-4a13-a7d4-0db0df8d399f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.939545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796ecc9-ff02-4a13-a7d4-0db0df8d399f admin admin] PATH_INFO: `/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.939545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796ecc9-ff02-4a13-a7d4-0db0df8d399f admin admin] RBAC: Authorizing `identity:get_group(group_id=304c6301e1244ad7b1c1b2082c6b7e72)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.939545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796ecc9-ff02-4a13-a7d4-0db0df8d399f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.939545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 165/327] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:00.947364 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214ea84-fbb6-462a-836c-fa2f3ee5903e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:00.965660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214ea84-fbb6-462a-836c-fa2f3ee5903e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:00.970587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafe6e9-2697-44eb-912d-70bb14cd47da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:00.971505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafe6e9-2697-44eb-912d-70bb14cd47da admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:00.972034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafe6e9-2697-44eb-912d-70bb14cd47da admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:00.972515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafe6e9-2697-44eb-912d-70bb14cd47da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:00.973589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafe6e9-2697-44eb-912d-70bb14cd47da admin admin] RBAC: Adding query filter params (group.id=304c6301e1244ad7b1c1b2082c6b7e72, role.id=8f120e43ae5140dbbe6dbdf88980fabe, scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:00.975443 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafe6e9-2697-44eb-912d-70bb14cd47da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:00.977663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafe6e9-2697-44eb-912d-70bb14cd47da admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:00.984714 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 163/328] 10.222.0.16 () {56 vars in 1398 bytes} [Sun Aug 29 14:18:00 2021] GET /identity/v3/role_assignments?group.id=304c6301e1244ad7b1c1b2082c6b7e72&scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8&role.id=8f120e43ae5140dbbe6dbdf88980fabe => generated 611 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:01.941550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658b8a-a168-4a8a-961b-d9c44eeca933 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:01.942162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658b8a-a168-4a8a-961b-d9c44eeca933 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:01.942162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658b8a-a168-4a8a-961b-d9c44eeca933 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:01.946006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 166/329] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:01.952828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbc152-cdd0-4511-86fb-a3f22a7c7345 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:01.952828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbc152-cdd0-4511-86fb-a3f22a7c7345 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:01.952828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbc152-cdd0-4511-86fb-a3f22a7c7345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:01.969846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-01bbc152-cdd0-4511-86fb-a3f22a7c7345 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:01.971116 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-01bbc152-cdd0-4511-86fb-a3f22a7c7345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:01.978797 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 164/330] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:01.997727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cda630-20bc-4b52-8f70-5d96e20c7bbf None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:01.998130 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cda630-20bc-4b52-8f70-5d96e20c7bbf None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:01.998473 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cda630-20bc-4b52-8f70-5d96e20c7bbf None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.001895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 167/331] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:02.006383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbc152-cdd0-4511-86fb-a3f22a7c7345 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.006952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274f9bf-5309-4067-8c86-42a689ff045b None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.007236 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274f9bf-5309-4067-8c86-42a689ff045b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.007510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274f9bf-5309-4067-8c86-42a689ff045b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.016511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbc152-cdd0-4511-86fb-a3f22a7c7345 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.023800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d536e-0ac0-4853-ae47-c499c7ba096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.024600 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d536e-0ac0-4853-ae47-c499c7ba096a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.024875 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d536e-0ac0-4853-ae47-c499c7ba096a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.025143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d536e-0ac0-4853-ae47-c499c7ba096a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.026051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-7274f9bf-5309-4067-8c86-42a689ff045b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:02.027870 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7274f9bf-5309-4067-8c86-42a689ff045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:02.037229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 168/332] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:02.042800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d536e-0ac0-4853-ae47-c499c7ba096a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:02.050198 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-2b7d536e-0ac0-4853-ae47-c499c7ba096a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:18:02.057040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 165/333] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:02.058224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274f9bf-5309-4067-8c86-42a689ff045b None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.062270 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d536e-0ac0-4853-ae47-c499c7ba096a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.067633 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274f9bf-5309-4067-8c86-42a689ff045b None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.072540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225175b-6425-47d6-be4d-5c94191ee9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.073067 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d536e-0ac0-4853-ae47-c499c7ba096a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.073240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225175b-6425-47d6-be4d-5c94191ee9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.073472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225175b-6425-47d6-be4d-5c94191ee9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.073742 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225175b-6425-47d6-be4d-5c94191ee9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.074511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225175b-6425-47d6-be4d-5c94191ee9c0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:02.074815 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225175b-6425-47d6-be4d-5c94191ee9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.076387 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225175b-6425-47d6-be4d-5c94191ee9c0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.077672 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a46398-c1e9-4573-9900-fdeb36d958a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.078654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a46398-c1e9-4573-9900-fdeb36d958a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.078654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a46398-c1e9-4573-9900-fdeb36d958a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.078949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a46398-c1e9-4573-9900-fdeb36d958a0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.085064 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 169/334] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:02.090631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225175b-6425-47d6-be4d-5c94191ee9c0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.091863 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a46398-c1e9-4573-9900-fdeb36d958a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:02.098684 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-30a46398-c1e9-4573-9900-fdeb36d958a0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 14:18:02.100230 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225175b-6425-47d6-be4d-5c94191ee9c0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.100343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 166/335] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:02.104391 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352fc2b-158f-49b1-8c5b-04b57b6b68cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.105015 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352fc2b-158f-49b1-8c5b-04b57b6b68cb admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.105435 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352fc2b-158f-49b1-8c5b-04b57b6b68cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.105610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352fc2b-158f-49b1-8c5b-04b57b6b68cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.106267 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a46398-c1e9-4573-9900-fdeb36d958a0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.113499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352fc2b-158f-49b1-8c5b-04b57b6b68cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.115853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a46398-c1e9-4573-9900-fdeb36d958a0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.116167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352fc2b-158f-49b1-8c5b-04b57b6b68cb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.120000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c570be-3bd4-49e2-8084-b430924d8044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.120619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c570be-3bd4-49e2-8084-b430924d8044 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.120902 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c570be-3bd4-49e2-8084-b430924d8044 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.121170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c570be-3bd4-49e2-8084-b430924d8044 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.121919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c570be-3bd4-49e2-8084-b430924d8044 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:02.122223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c570be-3bd4-49e2-8084-b430924d8044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.123790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c570be-3bd4-49e2-8084-b430924d8044 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.125357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 170/336] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:18:02.131908 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352fc2b-158f-49b1-8c5b-04b57b6b68cb admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.134066 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 167/337] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:02.140137 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c570be-3bd4-49e2-8084-b430924d8044 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.140647 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352fc2b-158f-49b1-8c5b-04b57b6b68cb admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.145027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273f4f6-2832-4391-b60c-c2ab4d88094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.145918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273f4f6-2832-4391-b60c-c2ab4d88094d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.146290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273f4f6-2832-4391-b60c-c2ab4d88094d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.146540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273f4f6-2832-4391-b60c-c2ab4d88094d admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.148191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273f4f6-2832-4391-b60c-c2ab4d88094d admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.150255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273f4f6-2832-4391-b60c-c2ab4d88094d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.150677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c570be-3bd4-49e2-8084-b430924d8044 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.152156 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 171/338] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:02.155185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33835a21-28df-4e7d-a2c3-d182c038aeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.155819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33835a21-28df-4e7d-a2c3-d182c038aeea admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.156104 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33835a21-28df-4e7d-a2c3-d182c038aeea admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.156380 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33835a21-28df-4e7d-a2c3-d182c038aeea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.157640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273f4f6-2832-4391-b60c-c2ab4d88094d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.165104 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33835a21-28df-4e7d-a2c3-d182c038aeea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.166825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273f4f6-2832-4391-b60c-c2ab4d88094d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.166926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33835a21-28df-4e7d-a2c3-d182c038aeea admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.171201 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721966c-0202-419e-a796-c65c36c3c01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.172025 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721966c-0202-419e-a796-c65c36c3c01b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.172307 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721966c-0202-419e-a796-c65c36c3c01b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.172595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721966c-0202-419e-a796-c65c36c3c01b admin admin] PATH_INFO: `/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.173735 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721966c-0202-419e-a796-c65c36c3c01b admin admin] RBAC: Authorizing `identity:get_group(group_id=304c6301e1244ad7b1c1b2082c6b7e72)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.175646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721966c-0202-419e-a796-c65c36c3c01b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.178021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 172/339] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:02.178523 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 168/340] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:18:02.183907 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721966c-0202-419e-a796-c65c36c3c01b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.185098 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33835a21-28df-4e7d-a2c3-d182c038aeea admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.195013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33835a21-28df-4e7d-a2c3-d182c038aeea admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.195637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721966c-0202-419e-a796-c65c36c3c01b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.199425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4763-2fdb-4051-9174-487dab872b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.200192 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411644f-4038-4d51-8f95-548cb6822728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.200307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4763-2fdb-4051-9174-487dab872b31 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.200543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4763-2fdb-4051-9174-487dab872b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.200823 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411644f-4038-4d51-8f95-548cb6822728 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.200931 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4763-2fdb-4051-9174-487dab872b31 admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.201129 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411644f-4038-4d51-8f95-548cb6822728 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.201366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411644f-4038-4d51-8f95-548cb6822728 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.202211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411644f-4038-4d51-8f95-548cb6822728 admin admin] RBAC: Adding query filter params (group.id=304c6301e1244ad7b1c1b2082c6b7e72, role.id=8f120e43ae5140dbbe6dbdf88980fabe, scope.project.id=5f868635149a44f4a2b5cb7811d17563) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:02.202307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c4763-2fdb-4051-9174-487dab872b31 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.202519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411644f-4038-4d51-8f95-548cb6822728 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.204229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c4763-2fdb-4051-9174-487dab872b31 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.204322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411644f-4038-4d51-8f95-548cb6822728 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.206193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 169/341] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:02.218097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 173/342] 10.222.0.16 () {56 vars in 1398 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/role_assignments?group.id=304c6301e1244ad7b1c1b2082c6b7e72&scope.project.id=5f868635149a44f4a2b5cb7811d17563&role.id=8f120e43ae5140dbbe6dbdf88980fabe => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:02.218300 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4763-2fdb-4051-9174-487dab872b31 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.222736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4763-2fdb-4051-9174-487dab872b31 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.228322 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052c4e0-758f-4c70-9dc4-49d193ecf1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.229203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c4e0-758f-4c70-9dc4-49d193ecf1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.229484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c4e0-758f-4c70-9dc4-49d193ecf1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.229760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c4e0-758f-4c70-9dc4-49d193ecf1d6 admin admin] PATH_INFO: `/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.231044 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052c4e0-758f-4c70-9dc4-49d193ecf1d6 admin admin] RBAC: Authorizing `identity:get_group(group_id=304c6301e1244ad7b1c1b2082c6b7e72)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.232981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052c4e0-758f-4c70-9dc4-49d193ecf1d6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.237936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 170/343] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/groups/304c6301e1244ad7b1c1b2082c6b7e72 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:02.242650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411644f-4038-4d51-8f95-548cb6822728 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.252711 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411644f-4038-4d51-8f95-548cb6822728 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.258757 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787e38a-2065-4486-970d-7598ee6db4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.259516 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787e38a-2065-4486-970d-7598ee6db4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.259868 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787e38a-2065-4486-970d-7598ee6db4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.260454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787e38a-2065-4486-970d-7598ee6db4d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.261362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787e38a-2065-4486-970d-7598ee6db4d3 admin admin] RBAC: Adding query filter params (group.id=304c6301e1244ad7b1c1b2082c6b7e72, role.id=8f6eaa48bff44ea8822a222e38de2feb, scope.project.id=5f868635149a44f4a2b5cb7811d17563) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:02.261740 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787e38a-2065-4486-970d-7598ee6db4d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.263705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787e38a-2065-4486-970d-7598ee6db4d3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.270681 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 174/344] 10.222.0.16 () {56 vars in 1398 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/role_assignments?group.id=304c6301e1244ad7b1c1b2082c6b7e72&scope.project.id=5f868635149a44f4a2b5cb7811d17563&role.id=8f6eaa48bff44ea8822a222e38de2feb => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:02.738247 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37a12c-328f-4ef1-954a-be8627bd9fdd None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.738536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37a12c-328f-4ef1-954a-be8627bd9fdd None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.738816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37a12c-328f-4ef1-954a-be8627bd9fdd None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.742694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 171/345] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:02.748657 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad92cf-b2dc-47a3-93f0-a235edde30fe None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.749084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad92cf-b2dc-47a3-93f0-a235edde30fe None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.752884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad92cf-b2dc-47a3-93f0-a235edde30fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.771569 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-25ad92cf-b2dc-47a3-93f0-a235edde30fe None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:02.773934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-25ad92cf-b2dc-47a3-93f0-a235edde30fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:02.780442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 175/346] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:02.805230 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37a12c-328f-4ef1-954a-be8627bd9fdd None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.816933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37a12c-328f-4ef1-954a-be8627bd9fdd None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.821119 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f282189-e108-4904-b773-77b3204dcf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.821913 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f282189-e108-4904-b773-77b3204dcf15 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.822197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f282189-e108-4904-b773-77b3204dcf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.822469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f282189-e108-4904-b773-77b3204dcf15 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.832752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f282189-e108-4904-b773-77b3204dcf15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:02.840068 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-1f282189-e108-4904-b773-77b3204dcf15 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:18:02.841187 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 172/347] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:02.847290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad92cf-b2dc-47a3-93f0-a235edde30fe None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.856768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad92cf-b2dc-47a3-93f0-a235edde30fe None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.861169 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09123bb1-0517-4a9a-9175-9721c0db2d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.861820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09123bb1-0517-4a9a-9175-9721c0db2d3d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.862127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09123bb1-0517-4a9a-9175-9721c0db2d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.862396 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09123bb1-0517-4a9a-9175-9721c0db2d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.863128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09123bb1-0517-4a9a-9175-9721c0db2d3d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:02.863426 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09123bb1-0517-4a9a-9175-9721c0db2d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.865022 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09123bb1-0517-4a9a-9175-9721c0db2d3d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.872918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 176/348] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:02.878704 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f282189-e108-4904-b773-77b3204dcf15 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.888344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f282189-e108-4904-b773-77b3204dcf15 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.892531 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44050abf-27a0-4c93-bc77-c29fc403a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.893159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44050abf-27a0-4c93-bc77-c29fc403a3fc admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.893418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44050abf-27a0-4c93-bc77-c29fc403a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.893690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44050abf-27a0-4c93-bc77-c29fc403a3fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.901819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44050abf-27a0-4c93-bc77-c29fc403a3fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.903584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44050abf-27a0-4c93-bc77-c29fc403a3fc admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.912636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 173/349] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:02.918417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09123bb1-0517-4a9a-9175-9721c0db2d3d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.927733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09123bb1-0517-4a9a-9175-9721c0db2d3d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.932070 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acdac0-abde-4c83-88c9-7c761807c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.932906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acdac0-abde-4c83-88c9-7c761807c7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.933188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acdac0-abde-4c83-88c9-7c761807c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.933461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acdac0-abde-4c83-88c9-7c761807c7a0 admin admin] PATH_INFO: `/v3/projects/3ee3fdc9b9a0424b897a4f05d6b3569f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.934660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acdac0-abde-4c83-88c9-7c761807c7a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=3ee3fdc9b9a0424b897a4f05d6b3569f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.936442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acdac0-abde-4c83-88c9-7c761807c7a0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.938104 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 177/350] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/projects/3ee3fdc9b9a0424b897a4f05d6b3569f => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:02.944053 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44050abf-27a0-4c93-bc77-c29fc403a3fc admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.952968 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44050abf-27a0-4c93-bc77-c29fc403a3fc admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.957239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb95224-5016-403c-8ee5-45eec628640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.958699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb95224-5016-403c-8ee5-45eec628640c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.959023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb95224-5016-403c-8ee5-45eec628640c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.959330 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb95224-5016-403c-8ee5-45eec628640c admin admin] PATH_INFO: `/v3/groups/7562e07653444c798c6efed6be73ff35` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.960460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb95224-5016-403c-8ee5-45eec628640c admin admin] RBAC: Authorizing `identity:get_group(group_id=7562e07653444c798c6efed6be73ff35)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.962407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb95224-5016-403c-8ee5-45eec628640c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.963971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 174/351] 10.222.0.16 () {56 vars in 1202 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/groups/7562e07653444c798c6efed6be73ff35 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:02.970218 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acdac0-abde-4c83-88c9-7c761807c7a0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:02.980367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acdac0-abde-4c83-88c9-7c761807c7a0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:02.984669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208d2ce-6cf4-4721-9c93-d79a8afd3927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:02.985303 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208d2ce-6cf4-4721-9c93-d79a8afd3927 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:02.985583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208d2ce-6cf4-4721-9c93-d79a8afd3927 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:02.985857 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208d2ce-6cf4-4721-9c93-d79a8afd3927 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:02.986711 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208d2ce-6cf4-4721-9c93-d79a8afd3927 admin admin] RBAC: Adding query filter params (group.id=7562e07653444c798c6efed6be73ff35, role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=3ee3fdc9b9a0424b897a4f05d6b3569f) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:02.987034 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208d2ce-6cf4-4721-9c93-d79a8afd3927 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:02.988883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208d2ce-6cf4-4721-9c93-d79a8afd3927 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:02.994522 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 178/352] 10.222.0.16 () {56 vars in 1398 bytes} [Sun Aug 29 14:18:02 2021] GET /identity/v3/role_assignments?group.id=7562e07653444c798c6efed6be73ff35&scope.project.id=3ee3fdc9b9a0424b897a4f05d6b3569f&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:05.732096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca028d6e-1da2-49b9-9c3e-a6fb347713cc None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:05.732617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca028d6e-1da2-49b9-9c3e-a6fb347713cc None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:05.732617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca028d6e-1da2-49b9-9c3e-a6fb347713cc None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:05.734419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 175/353] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:05.741821 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae4114-e9e2-442a-b9fa-050513d2e18f None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:05.742300 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae4114-e9e2-442a-b9fa-050513d2e18f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:05.742376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae4114-e9e2-442a-b9fa-050513d2e18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:05.766906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-31ae4114-e9e2-442a-b9fa-050513d2e18f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:05.768104 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-31ae4114-e9e2-442a-b9fa-050513d2e18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:05.780934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 179/354] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:05.826782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca028d6e-1da2-49b9-9c3e-a6fb347713cc None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:05.841229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca028d6e-1da2-49b9-9c3e-a6fb347713cc None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:05.848224 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bd68c-38d9-4d11-8755-a08b2df6fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:05.849476 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bd68c-38d9-4d11-8755-a08b2df6fedd admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:05.849820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bd68c-38d9-4d11-8755-a08b2df6fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:05.850120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bd68c-38d9-4d11-8755-a08b2df6fedd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:05.861296 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bd68c-38d9-4d11-8755-a08b2df6fedd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:05.863484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bd68c-38d9-4d11-8755-a08b2df6fedd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:05.888707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-2b7bd68c-38d9-4d11-8755-a08b2df6fedd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:05.890410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 176/355] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:05.898958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae4114-e9e2-442a-b9fa-050513d2e18f None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:05.905662 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041ee77-c15c-40fd-a4f7-ab25913fefe2 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:05.906243 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041ee77-c15c-40fd-a4f7-ab25913fefe2 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:05.906727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041ee77-c15c-40fd-a4f7-ab25913fefe2 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:05.908676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 177/356] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:05.909046 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae4114-e9e2-442a-b9fa-050513d2e18f None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:05.918364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c34a3-e71b-47d9-a898-d6fa69fc6bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:05.919033 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c34a3-e71b-47d9-a898-d6fa69fc6bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:05.919312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c34a3-e71b-47d9-a898-d6fa69fc6bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:05.919583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c34a3-e71b-47d9-a898-d6fa69fc6bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:05.919694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd8700-53f7-4028-9688-3ee3e0e02032 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:05.920160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd8700-53f7-4028-9688-3ee3e0e02032 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:05.920327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c34a3-e71b-47d9-a898-d6fa69fc6bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:05.920599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c34a3-e71b-47d9-a898-d6fa69fc6bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:05.920986 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd8700-53f7-4028-9688-3ee3e0e02032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:05.921608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-4f8c34a3-e71b-47d9-a898-d6fa69fc6bf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:05.921608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:18:05.921608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:18:05.922528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c34a3-e71b-47d9-a898-d6fa69fc6bf0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:05.945903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 180/357] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:05.954031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c34a3-e71b-47d9-a898-d6fa69fc6bf0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:05.956736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-abbd8700-53f7-4028-9688-3ee3e0e02032 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:05.958040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-abbd8700-53f7-4028-9688-3ee3e0e02032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:05.967789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c34a3-e71b-47d9-a898-d6fa69fc6bf0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:05.972133 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 178/358] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:05.975607 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f24f-c020-4c31-815b-eaac2dfa4736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:05.976293 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f24f-c020-4c31-815b-eaac2dfa4736 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:05.976572 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f24f-c020-4c31-815b-eaac2dfa4736 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:05.976847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f24f-c020-4c31-815b-eaac2dfa4736 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:05.977559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604f24f-c020-4c31-815b-eaac2dfa4736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:05.979509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604f24f-c020-4c31-815b-eaac2dfa4736 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:06.013087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd8700-53f7-4028-9688-3ee3e0e02032 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:06.016326 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd8700-53f7-4028-9688-3ee3e0e02032 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:06.024560 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b1a25-4d17-4e84-a715-76e279f37e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:06.025380 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b1a25-4d17-4e84-a715-76e279f37e4e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.025660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b1a25-4d17-4e84-a715-76e279f37e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.025956 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b1a25-4d17-4e84-a715-76e279f37e4e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.038162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b1a25-4d17-4e84-a715-76e279f37e4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:06.040200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b1a25-4d17-4e84-a715-76e279f37e4e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:06.059070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-500b1a25-4d17-4e84-a715-76e279f37e4e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:06.060293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 179/359] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:06.066690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b1a25-4d17-4e84-a715-76e279f37e4e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:06.077376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b1a25-4d17-4e84-a715-76e279f37e4e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:06.083022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057ff3d-cdef-40b8-b0ae-595451da09ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:06.083764 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057ff3d-cdef-40b8-b0ae-595451da09ac admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.084055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057ff3d-cdef-40b8-b0ae-595451da09ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.084331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057ff3d-cdef-40b8-b0ae-595451da09ac admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.085053 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057ff3d-cdef-40b8-b0ae-595451da09ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:06.085353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057ff3d-cdef-40b8-b0ae-595451da09ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:06.086957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057ff3d-cdef-40b8-b0ae-595451da09ac admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:06.097040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 181/360] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:18:05 2021] POST /identity/v3/users => generated 246 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:18:06.107548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 180/361] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:06.114834 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19025c-b7a8-4ba9-ac88-ba280ef0a98a None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.115152 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19025c-b7a8-4ba9-ac88-ba280ef0a98a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.115355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19025c-b7a8-4ba9-ac88-ba280ef0a98a None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.117787 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 182/362] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:06.118987 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057ff3d-cdef-40b8-b0ae-595451da09ac admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:06.124253 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592aac2-2ed0-4a5e-9a1e-0ed04b715dee None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.124527 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592aac2-2ed0-4a5e-9a1e-0ed04b715dee None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.124804 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592aac2-2ed0-4a5e-9a1e-0ed04b715dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.136339 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057ff3d-cdef-40b8-b0ae-595451da09ac admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:06.141177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e45b3-caa1-45d6-8f67-f781c3b75714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:06.141886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e45b3-caa1-45d6-8f67-f781c3b75714 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.142176 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e45b3-caa1-45d6-8f67-f781c3b75714 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.142445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e45b3-caa1-45d6-8f67-f781c3b75714 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.143145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e45b3-caa1-45d6-8f67-f781c3b75714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:06.144156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-583e45b3-caa1-45d6-8f67-f781c3b75714 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:06.144156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:18:06.144156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:18:06.145383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e45b3-caa1-45d6-8f67-f781c3b75714 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:06.247007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 181/363] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:18:06 2021] POST /identity/v3/users => generated 248 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:06.279833 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-8592aac2-2ed0-4a5e-9a1e-0ed04b715dee None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:06.281103 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8592aac2-2ed0-4a5e-9a1e-0ed04b715dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:06.294033 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 183/364] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:06.318948 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e45b3-caa1-45d6-8f67-f781c3b75714 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:06.330804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e45b3-caa1-45d6-8f67-f781c3b75714 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:06.335573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b213842-163e-4d6f-9a96-adaa12c6a43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:06.336391 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b213842-163e-4d6f-9a96-adaa12c6a43d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.336668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b213842-163e-4d6f-9a96-adaa12c6a43d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.336938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b213842-163e-4d6f-9a96-adaa12c6a43d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.351001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b213842-163e-4d6f-9a96-adaa12c6a43d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:06.352896 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b213842-163e-4d6f-9a96-adaa12c6a43d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:06.372029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-0b213842-163e-4d6f-9a96-adaa12c6a43d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:06.377967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 182/365] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:06.380337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592aac2-2ed0-4a5e-9a1e-0ed04b715dee None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:06.390612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592aac2-2ed0-4a5e-9a1e-0ed04b715dee None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:06.395488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d6eb3-83a3-4500-be46-bbee0b42a95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:06.396206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d6eb3-83a3-4500-be46-bbee0b42a95e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.396534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d6eb3-83a3-4500-be46-bbee0b42a95e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.396809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d6eb3-83a3-4500-be46-bbee0b42a95e admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.397548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d6eb3-83a3-4500-be46-bbee0b42a95e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:06.397847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d6eb3-83a3-4500-be46-bbee0b42a95e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:06.399476 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d6eb3-83a3-4500-be46-bbee0b42a95e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:06.415828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 184/366] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:06.421179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b213842-163e-4d6f-9a96-adaa12c6a43d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:06.432145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b213842-163e-4d6f-9a96-adaa12c6a43d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:06.436765 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf7ff0-9988-4d4c-b674-17dec33171cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:06.437451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf7ff0-9988-4d4c-b674-17dec33171cf admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.437783 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf7ff0-9988-4d4c-b674-17dec33171cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.438093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf7ff0-9988-4d4c-b674-17dec33171cf admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.438865 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf7ff0-9988-4d4c-b674-17dec33171cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:06.440870 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf7ff0-9988-4d4c-b674-17dec33171cf admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:06.515368 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 183/367] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:18:06 2021] POST /identity/v3/users => generated 248 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:06.609403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06f1a-7a6a-490b-973f-f3afeada2c33 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.609702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06f1a-7a6a-490b-973f-f3afeada2c33 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.609966 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06f1a-7a6a-490b-973f-f3afeada2c33 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.612214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 185/368] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:06.619309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dbe91-d298-4639-84d2-38fb6dd375dc None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.619595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dbe91-d298-4639-84d2-38fb6dd375dc None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.619860 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dbe91-d298-4639-84d2-38fb6dd375dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.640004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-257dbe91-d298-4639-84d2-38fb6dd375dc None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:06.641230 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-257dbe91-d298-4639-84d2-38fb6dd375dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:06.649670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 184/369] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:06.674842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d06f1a-7a6a-490b-973f-f3afeada2c33 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:06.690419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d06f1a-7a6a-490b-973f-f3afeada2c33 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:06.695525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b640aa-a4a0-4010-a42c-d304a6d3903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:06.696376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b640aa-a4a0-4010-a42c-d304a6d3903f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.696655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b640aa-a4a0-4010-a42c-d304a6d3903f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.696930 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b640aa-a4a0-4010-a42c-d304a6d3903f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.709776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b640aa-a4a0-4010-a42c-d304a6d3903f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:06.711705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b640aa-a4a0-4010-a42c-d304a6d3903f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:06.729316 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-c0b640aa-a4a0-4010-a42c-d304a6d3903f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:06.730561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 186/370] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:06.741890 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dbe91-d298-4639-84d2-38fb6dd375dc None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:06.750921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dbe91-d298-4639-84d2-38fb6dd375dc None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:06.764512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1312fb-1983-44a6-b4e1-fe3a74ececd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:06.765634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1312fb-1983-44a6-b4e1-fe3a74ececd1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.766139 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1312fb-1983-44a6-b4e1-fe3a74ececd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.766605 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1312fb-1983-44a6-b4e1-fe3a74ececd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.767777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1312fb-1983-44a6-b4e1-fe3a74ececd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:06.768286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1312fb-1983-44a6-b4e1-fe3a74ececd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:06.770305 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1312fb-1983-44a6-b4e1-fe3a74ececd1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:06.787099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 185/371] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:06.792651 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b640aa-a4a0-4010-a42c-d304a6d3903f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:06.804071 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b640aa-a4a0-4010-a42c-d304a6d3903f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:06.808595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66cd64-a4f4-41ce-9fa7-d3cf274c6723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:06.809264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66cd64-a4f4-41ce-9fa7-d3cf274c6723 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:06.809545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66cd64-a4f4-41ce-9fa7-d3cf274c6723 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:06.809897 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66cd64-a4f4-41ce-9fa7-d3cf274c6723 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:06.810615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66cd64-a4f4-41ce-9fa7-d3cf274c6723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:06.812632 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66cd64-a4f4-41ce-9fa7-d3cf274c6723 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:06.932007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 187/372] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:18:06 2021] POST /identity/v3/users => generated 249 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:18:07.394281 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadad32a-60ed-4a86-a9ed-adb8d164556e None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:07.394682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadad32a-60ed-4a86-a9ed-adb8d164556e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:07.394860 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadad32a-60ed-4a86-a9ed-adb8d164556e None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:07.396947 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 186/373] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:07.404099 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138e85-70a4-4e6a-aeba-3131f99dbf51 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:07.404393 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138e85-70a4-4e6a-aeba-3131f99dbf51 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:07.404671 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138e85-70a4-4e6a-aeba-3131f99dbf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:07.423235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-88138e85-70a4-4e6a-aeba-3131f99dbf51 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:07.424409 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-88138e85-70a4-4e6a-aeba-3131f99dbf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:07.432459 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 188/374] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:07.456346 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadad32a-60ed-4a86-a9ed-adb8d164556e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:07.468545 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadad32a-60ed-4a86-a9ed-adb8d164556e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:07.472898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a355a8c-013d-4879-9cd4-7ca22538f9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:07.473611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a355a8c-013d-4879-9cd4-7ca22538f9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:07.473923 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a355a8c-013d-4879-9cd4-7ca22538f9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:07.474369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a355a8c-013d-4879-9cd4-7ca22538f9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:07.475115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a355a8c-013d-4879-9cd4-7ca22538f9a6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:07.476702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a355a8c-013d-4879-9cd4-7ca22538f9a6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:07.519503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.sql.core [None req-5a355a8c-013d-4879-9cd4-7ca22538f9a6 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 14:18:07.519503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 14:18:07.519503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [parameters: {'id': 'ed7c7c93d4b24b989298469e1fe322cb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 14:18:07.519503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73674) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 14:18:07.534332 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-5a355a8c-013d-4879-9cd4-7ca22538f9a6 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 14:18:07.536693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 187/375] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:18:07 2021] POST /identity/v3/roles => generated 144 bytes in 80 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:07.543248 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88138e85-70a4-4e6a-aeba-3131f99dbf51 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:07.553706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88138e85-70a4-4e6a-aeba-3131f99dbf51 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:07.559567 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ec8c1-02af-4a07-906a-1cef88014b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:07.560511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ec8c1-02af-4a07-906a-1cef88014b6e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:07.560797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ec8c1-02af-4a07-906a-1cef88014b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:07.567799 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ec8c1-02af-4a07-906a-1cef88014b6e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:07.576683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ec8c1-02af-4a07-906a-1cef88014b6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:07.585332 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-666ec8c1-02af-4a07-906a-1cef88014b6e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 14:18:07.586975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 189/376] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:18:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:07.593357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a355a8c-013d-4879-9cd4-7ca22538f9a6 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:07.606329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a355a8c-013d-4879-9cd4-7ca22538f9a6 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:07.612048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261afd2-bf5b-4cdf-a307-dcf4fc5446b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:07.612714 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261afd2-bf5b-4cdf-a307-dcf4fc5446b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:07.613001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261afd2-bf5b-4cdf-a307-dcf4fc5446b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:07.613322 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261afd2-bf5b-4cdf-a307-dcf4fc5446b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:07.614196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261afd2-bf5b-4cdf-a307-dcf4fc5446b1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:07.614505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261afd2-bf5b-4cdf-a307-dcf4fc5446b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:07.616102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261afd2-bf5b-4cdf-a307-dcf4fc5446b1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:07.624706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 188/377] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:08.720007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d1fb3-64c8-496e-b560-2b5856fe6389 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:08.720978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d1fb3-64c8-496e-b560-2b5856fe6389 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:08.721459 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d1fb3-64c8-496e-b560-2b5856fe6389 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:08.724354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 190/378] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:08.730676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73747bac-9cd1-41b9-be4d-bcbd75edc63e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:08.731503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73747bac-9cd1-41b9-be4d-bcbd75edc63e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:08.731974 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73747bac-9cd1-41b9-be4d-bcbd75edc63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:08.750610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-73747bac-9cd1-41b9-be4d-bcbd75edc63e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:08.752117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-73747bac-9cd1-41b9-be4d-bcbd75edc63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:08.760924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 189/379] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:08.787066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d1fb3-64c8-496e-b560-2b5856fe6389 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:08.804057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d1fb3-64c8-496e-b560-2b5856fe6389 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:08.812449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df72fe-05c7-42ee-8b6a-239203e64c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:08.813486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df72fe-05c7-42ee-8b6a-239203e64c48 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:08.813988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df72fe-05c7-42ee-8b6a-239203e64c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:08.814497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df72fe-05c7-42ee-8b6a-239203e64c48 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:08.828115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df72fe-05c7-42ee-8b6a-239203e64c48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:08.835635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-24df72fe-05c7-42ee-8b6a-239203e64c48 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:08.837167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 191/380] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:08.843632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73747bac-9cd1-41b9-be4d-bcbd75edc63e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:08.859447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73747bac-9cd1-41b9-be4d-bcbd75edc63e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:08.870462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0ab35-54f7-486b-9589-54db6c88cdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:08.871364 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0ab35-54f7-486b-9589-54db6c88cdca admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:08.871837 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0ab35-54f7-486b-9589-54db6c88cdca admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:08.872341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0ab35-54f7-486b-9589-54db6c88cdca admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:08.873282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0ab35-54f7-486b-9589-54db6c88cdca admin admin] RBAC: Adding query filter params (name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:08.873774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0ab35-54f7-486b-9589-54db6c88cdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:08.875549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0ab35-54f7-486b-9589-54db6c88cdca admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:08.888888 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 190/381] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:08.895776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df72fe-05c7-42ee-8b6a-239203e64c48 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:08.906683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df72fe-05c7-42ee-8b6a-239203e64c48 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:08.916177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2bf03-6c20-44d8-a9c0-d46bdfb8ce53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:08.917365 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2bf03-6c20-44d8-a9c0-d46bdfb8ce53 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:08.917896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2bf03-6c20-44d8-a9c0-d46bdfb8ce53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:08.918385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2bf03-6c20-44d8-a9c0-d46bdfb8ce53 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:08.939296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2bf03-6c20-44d8-a9c0-d46bdfb8ce53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:08.941531 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2bf03-6c20-44d8-a9c0-d46bdfb8ce53 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:08.974344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-03d2bf03-6c20-44d8-a9c0-d46bdfb8ce53 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:08.975672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 192/382] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:08.982107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0ab35-54f7-486b-9589-54db6c88cdca admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:08.993205 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0ab35-54f7-486b-9589-54db6c88cdca admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.002229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59307b8-535f-4a2d-81fc-466c917cc662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.002895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59307b8-535f-4a2d-81fc-466c917cc662 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.003173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59307b8-535f-4a2d-81fc-466c917cc662 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.003442 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59307b8-535f-4a2d-81fc-466c917cc662 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.004167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59307b8-535f-4a2d-81fc-466c917cc662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.004467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59307b8-535f-4a2d-81fc-466c917cc662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.006127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59307b8-535f-4a2d-81fc-466c917cc662 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.028226 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 191/383] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:09.034478 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2bf03-6c20-44d8-a9c0-d46bdfb8ce53 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.050966 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2bf03-6c20-44d8-a9c0-d46bdfb8ce53 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.060994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb9e1c-f479-477d-b340-cdb40d6e7176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.061788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9e1c-f479-477d-b340-cdb40d6e7176 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.062090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9e1c-f479-477d-b340-cdb40d6e7176 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.062359 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9e1c-f479-477d-b340-cdb40d6e7176 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.075462 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb9e1c-f479-477d-b340-cdb40d6e7176 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.077610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb9e1c-f479-477d-b340-cdb40d6e7176 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.098322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-abfb9e1c-f479-477d-b340-cdb40d6e7176 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 14:18:09.099819 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 193/384] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:09.106684 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59307b8-535f-4a2d-81fc-466c917cc662 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.120405 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59307b8-535f-4a2d-81fc-466c917cc662 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.130359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b5411-c8d4-44e5-85e3-7c80e299cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.131039 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b5411-c8d4-44e5-85e3-7c80e299cde3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.131317 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b5411-c8d4-44e5-85e3-7c80e299cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.131588 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b5411-c8d4-44e5-85e3-7c80e299cde3 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.132430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b5411-c8d4-44e5-85e3-7c80e299cde3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.132733 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b5411-c8d4-44e5-85e3-7c80e299cde3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.133738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-819b5411-c8d4-44e5-85e3-7c80e299cde3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:09.133738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:18:09.133738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:18:09.135325 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b5411-c8d4-44e5-85e3-7c80e299cde3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.168205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24644a68-1d0b-4194-b5f1-4a2522730919 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.168507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24644a68-1d0b-4194-b5f1-4a2522730919 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.168783 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24644a68-1d0b-4194-b5f1-4a2522730919 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.170799 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 194/385] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:09.176444 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cd0ab-7b10-4882-8cd2-a0c9ec950088 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.176737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cd0ab-7b10-4882-8cd2-a0c9ec950088 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.177021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cd0ab-7b10-4882-8cd2-a0c9ec950088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.181792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 192/386] 10.222.0.16 () {56 vars in 1155 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:09.183141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99177d23-8b0e-4a8a-b74c-f1629d7c93ed None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.183429 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99177d23-8b0e-4a8a-b74c-f1629d7c93ed None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.183705 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99177d23-8b0e-4a8a-b74c-f1629d7c93ed None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.185444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 193/387] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:09.191675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d7439-c830-4790-9acb-0c1c4c437df3 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.191811 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d7439-c830-4790-9acb-0c1c4c437df3 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.192684 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d7439-c830-4790-9acb-0c1c4c437df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.197201 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-5a5cd0ab-7b10-4882-8cd2-a0c9ec950088 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:09.198611 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5a5cd0ab-7b10-4882-8cd2-a0c9ec950088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:09.208390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 195/388] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:09.209242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cd0ab-7b10-4882-8cd2-a0c9ec950088 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.212157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-7a2d7439-c830-4790-9acb-0c1c4c437df3 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:09.213584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7a2d7439-c830-4790-9acb-0c1c4c437df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:09.218892 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cd0ab-7b10-4882-8cd2-a0c9ec950088 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.222492 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 194/389] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:09.224058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dfa80-c457-4594-a9b4-36612166a10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.224749 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dfa80-c457-4594-a9b4-36612166a10f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.224979 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dfa80-c457-4594-a9b4-36612166a10f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.225266 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dfa80-c457-4594-a9b4-36612166a10f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.233533 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dfa80-c457-4594-a9b4-36612166a10f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.235299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dfa80-c457-4594-a9b4-36612166a10f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.244931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 196/390] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:09.247554 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d7439-c830-4790-9acb-0c1c4c437df3 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.250847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dfa80-c457-4594-a9b4-36612166a10f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.257649 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d7439-c830-4790-9acb-0c1c4c437df3 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.261536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dfa80-c457-4594-a9b4-36612166a10f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.263312 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c47ca3-8dd8-4fa8-94b7-c6467e319c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.264593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c47ca3-8dd8-4fa8-94b7-c6467e319c99 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.265069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c47ca3-8dd8-4fa8-94b7-c6467e319c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.265535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c47ca3-8dd8-4fa8-94b7-c6467e319c99 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.266427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cfcc1-6940-4ae0-bcdd-3f74b30764f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.267277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cfcc1-6940-4ae0-bcdd-3f74b30764f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.267565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cfcc1-6940-4ae0-bcdd-3f74b30764f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.267845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cfcc1-6940-4ae0-bcdd-3f74b30764f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.277481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c47ca3-8dd8-4fa8-94b7-c6467e319c99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:09.279984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cfcc1-6940-4ae0-bcdd-3f74b30764f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.281827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cfcc1-6940-4ae0-bcdd-3f74b30764f2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.285687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-59c47ca3-8dd8-4fa8-94b7-c6467e319c99 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:09.288076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 195/391] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:09.289040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c47ca3-8dd8-4fa8-94b7-c6467e319c99 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.299654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c47ca3-8dd8-4fa8-94b7-c6467e319c99 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.300418 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-d16cfcc1-6940-4ae0-bcdd-3f74b30764f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:09.302628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 197/392] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:09.303512 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cfcc1-6940-4ae0-bcdd-3f74b30764f2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.314857 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ee632-fb99-488e-8997-2d4ff42c6f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.315644 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ee632-fb99-488e-8997-2d4ff42c6f6b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.315921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ee632-fb99-488e-8997-2d4ff42c6f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.316189 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ee632-fb99-488e-8997-2d4ff42c6f6b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.323195 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cfcc1-6940-4ae0-bcdd-3f74b30764f2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.329606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c843f-a0ef-4f5b-a9f1-99cb00f3b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.330342 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c843f-a0ef-4f5b-a9f1-99cb00f3b45b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.330621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c843f-a0ef-4f5b-a9f1-99cb00f3b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.330892 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c843f-a0ef-4f5b-a9f1-99cb00f3b45b admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.331689 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c843f-a0ef-4f5b-a9f1-99cb00f3b45b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.331910 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ee632-fb99-488e-8997-2d4ff42c6f6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:09.332010 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c843f-a0ef-4f5b-a9f1-99cb00f3b45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.333768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c843f-a0ef-4f5b-a9f1-99cb00f3b45b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.340727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-6e5ee632-fb99-488e-8997-2d4ff42c6f6b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:09.342190 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 196/393] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:09.342429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 198/394] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:09.343328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ee632-fb99-488e-8997-2d4ff42c6f6b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.348906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c843f-a0ef-4f5b-a9f1-99cb00f3b45b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.354689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ee632-fb99-488e-8997-2d4ff42c6f6b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.358900 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c843f-a0ef-4f5b-a9f1-99cb00f3b45b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.360456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5c04f-9b48-4df2-86c6-7dd7d34c91ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.361472 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5c04f-9b48-4df2-86c6-7dd7d34c91ff admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.362064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5c04f-9b48-4df2-86c6-7dd7d34c91ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.362670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5c04f-9b48-4df2-86c6-7dd7d34c91ff admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.363651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5c04f-9b48-4df2-86c6-7dd7d34c91ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.363756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f14fd-9d21-45ba-a46e-ee4bf4abd468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.364784 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5c04f-9b48-4df2-86c6-7dd7d34c91ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.365824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f14fd-9d21-45ba-a46e-ee4bf4abd468 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.366385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f14fd-9d21-45ba-a46e-ee4bf4abd468 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.366841 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f14fd-9d21-45ba-a46e-ee4bf4abd468 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.367212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5c04f-9b48-4df2-86c6-7dd7d34c91ff admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.378416 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f14fd-9d21-45ba-a46e-ee4bf4abd468 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.380597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f14fd-9d21-45ba-a46e-ee4bf4abd468 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.382743 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 197/395] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:09.383770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5c04f-9b48-4df2-86c6-7dd7d34c91ff admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.394938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5c04f-9b48-4df2-86c6-7dd7d34c91ff admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.400092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7d588-66fd-40b6-b6d4-0b4b01a15fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.401013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7d588-66fd-40b6-b6d4-0b4b01a15fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.401498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7d588-66fd-40b6-b6d4-0b4b01a15fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.402004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7d588-66fd-40b6-b6d4-0b4b01a15fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.403029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7d588-66fd-40b6-b6d4-0b4b01a15fa0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.403354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-1d7f14fd-9d21-45ba-a46e-ee4bf4abd468 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:09.403788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7d588-66fd-40b6-b6d4-0b4b01a15fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.405689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7d588-66fd-40b6-b6d4-0b4b01a15fa0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.410042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 199/396] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:09.411790 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f14fd-9d21-45ba-a46e-ee4bf4abd468 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.417528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 198/397] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:09.419361 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7d588-66fd-40b6-b6d4-0b4b01a15fa0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.422733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f14fd-9d21-45ba-a46e-ee4bf4abd468 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.428737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0e339-b94a-4914-b336-c50978522ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.429598 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0e339-b94a-4914-b336-c50978522ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.429879 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0e339-b94a-4914-b336-c50978522ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.430167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0e339-b94a-4914-b336-c50978522ac3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.432617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7d588-66fd-40b6-b6d4-0b4b01a15fa0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.437753 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b010159-55f8-4a6e-8e7e-1d8892f14333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.438180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0e339-b94a-4914-b336-c50978522ac3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.438838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b010159-55f8-4a6e-8e7e-1d8892f14333 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.439293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b010159-55f8-4a6e-8e7e-1d8892f14333 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.439740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b010159-55f8-4a6e-8e7e-1d8892f14333 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.440388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0e339-b94a-4914-b336-c50978522ac3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.441038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b010159-55f8-4a6e-8e7e-1d8892f14333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.441518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b010159-55f8-4a6e-8e7e-1d8892f14333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.443862 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b010159-55f8-4a6e-8e7e-1d8892f14333 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.454358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-0ac0e339-b94a-4914-b336-c50978522ac3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:09.455570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 200/398] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:09.458682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 199/399] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:09.461554 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0e339-b94a-4914-b336-c50978522ac3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.462852 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b010159-55f8-4a6e-8e7e-1d8892f14333 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.471451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0e339-b94a-4914-b336-c50978522ac3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.475457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b010159-55f8-4a6e-8e7e-1d8892f14333 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.476761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602fc28-e12e-4210-957e-79685bc28882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.477554 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602fc28-e12e-4210-957e-79685bc28882 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.477952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602fc28-e12e-4210-957e-79685bc28882 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.478228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602fc28-e12e-4210-957e-79685bc28882 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.481660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655daab5-e4df-4188-a340-18f20ad565c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.482530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655daab5-e4df-4188-a340-18f20ad565c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.483005 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655daab5-e4df-4188-a340-18f20ad565c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.483452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655daab5-e4df-4188-a340-18f20ad565c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.484429 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655daab5-e4df-4188-a340-18f20ad565c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.484905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655daab5-e4df-4188-a340-18f20ad565c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.486539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-655daab5-e4df-4188-a340-18f20ad565c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:09.486539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:18:09.486539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:18:09.488389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655daab5-e4df-4188-a340-18f20ad565c2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.490610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602fc28-e12e-4210-957e-79685bc28882 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.492543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602fc28-e12e-4210-957e-79685bc28882 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.512079 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 200/400] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:09.512766 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655daab5-e4df-4188-a340-18f20ad565c2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.515240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-1602fc28-e12e-4210-957e-79685bc28882 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:09.516637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 201/401] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:09.518128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602fc28-e12e-4210-957e-79685bc28882 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.528797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602fc28-e12e-4210-957e-79685bc28882 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.528960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655daab5-e4df-4188-a340-18f20ad565c2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.533754 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547011e-5770-4f81-853e-772ba042bfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.534449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f681aa-716a-4954-9213-7e56838cfde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.534678 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547011e-5770-4f81-853e-772ba042bfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.534964 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547011e-5770-4f81-853e-772ba042bfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.535298 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547011e-5770-4f81-853e-772ba042bfc0 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.535809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f681aa-716a-4954-9213-7e56838cfde5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.536879 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f681aa-716a-4954-9213-7e56838cfde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.537290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f681aa-716a-4954-9213-7e56838cfde5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.538285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f681aa-716a-4954-9213-7e56838cfde5 admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=d8c0afa8f09f4923b9c8ab2696156129) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.538757 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f681aa-716a-4954-9213-7e56838cfde5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.540729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f681aa-716a-4954-9213-7e56838cfde5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.544208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547011e-5770-4f81-853e-772ba042bfc0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.546056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547011e-5770-4f81-853e-772ba042bfc0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.547665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 202/402] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/role_assignments?user.id=d8c0afa8f09f4923b9c8ab2696156129&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:09.548677 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f681aa-716a-4954-9213-7e56838cfde5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.559007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f681aa-716a-4954-9213-7e56838cfde5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.561250 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-2547011e-5770-4f81-853e-772ba042bfc0 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 14:18:09.562699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 201/403] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:09.564765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c821-de4a-4bc7-8d38-c5c54e1173d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.565666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c821-de4a-4bc7-8d38-c5c54e1173d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.566133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c821-de4a-4bc7-8d38-c5c54e1173d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.566544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c821-de4a-4bc7-8d38-c5c54e1173d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.567621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559c821-de4a-4bc7-8d38-c5c54e1173d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.568380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559c821-de4a-4bc7-8d38-c5c54e1173d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.569124 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547011e-5770-4f81-853e-772ba042bfc0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.570476 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559c821-de4a-4bc7-8d38-c5c54e1173d1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.579614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547011e-5770-4f81-853e-772ba042bfc0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.585320 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e36cd-1bdb-4d1e-987b-09afb06401d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.586099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e36cd-1bdb-4d1e-987b-09afb06401d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.586382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e36cd-1bdb-4d1e-987b-09afb06401d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.586719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e36cd-1bdb-4d1e-987b-09afb06401d8 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.587491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 203/404] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:09.587611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e36cd-1bdb-4d1e-987b-09afb06401d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.587942 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e36cd-1bdb-4d1e-987b-09afb06401d8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.589843 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e36cd-1bdb-4d1e-987b-09afb06401d8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.599622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c821-de4a-4bc7-8d38-c5c54e1173d1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.615167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 202/405] 10.222.0.16 () {56 vars in 1159 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:09.615727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c821-de4a-4bc7-8d38-c5c54e1173d1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.621289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e36cd-1bdb-4d1e-987b-09afb06401d8 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.631654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e36cd-1bdb-4d1e-987b-09afb06401d8 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.634840 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d801db-1fe4-47a3-8b02-c7da6bcc2531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.635666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d801db-1fe4-47a3-8b02-c7da6bcc2531 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.635944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d801db-1fe4-47a3-8b02-c7da6bcc2531 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.636214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d801db-1fe4-47a3-8b02-c7da6bcc2531 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.636559 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970a3ce-7c84-46dc-933b-f7a1a3ef9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.637230 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970a3ce-7c84-46dc-933b-f7a1a3ef9e8c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.637511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970a3ce-7c84-46dc-933b-f7a1a3ef9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.637782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970a3ce-7c84-46dc-933b-f7a1a3ef9e8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.654363 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d801db-1fe4-47a3-8b02-c7da6bcc2531 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.656410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d801db-1fe4-47a3-8b02-c7da6bcc2531 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.657704 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970a3ce-7c84-46dc-933b-f7a1a3ef9e8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.659680 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970a3ce-7c84-46dc-933b-f7a1a3ef9e8c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.670963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 203/406] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:18:09.677194 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970a3ce-7c84-46dc-933b-f7a1a3ef9e8c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.686608 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970a3ce-7c84-46dc-933b-f7a1a3ef9e8c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.690404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-46d801db-1fe4-47a3-8b02-c7da6bcc2531 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 14:18:09.691235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ac713-0a00-417c-9f08-d837cac664ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.692260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ac713-0a00-417c-9f08-d837cac664ec admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.692389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ac713-0a00-417c-9f08-d837cac664ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.692624 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ac713-0a00-417c-9f08-d837cac664ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.698652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 204/407] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/users/cinder => generated 84 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:09.706937 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d801db-1fe4-47a3-8b02-c7da6bcc2531 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.710452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ac713-0a00-417c-9f08-d837cac664ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.712349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ac713-0a00-417c-9f08-d837cac664ec admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.729304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d801db-1fe4-47a3-8b02-c7da6bcc2531 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.731043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-401ac713-0a00-417c-9f08-d837cac664ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:09.732393 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 204/408] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:09.738699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ac713-0a00-417c-9f08-d837cac664ec admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.740846 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19afe2-8877-4845-ba77-65871263f6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.741638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19afe2-8877-4845-ba77-65871263f6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.742045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19afe2-8877-4845-ba77-65871263f6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.742413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19afe2-8877-4845-ba77-65871263f6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.743358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19afe2-8877-4845-ba77-65871263f6e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.743761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19afe2-8877-4845-ba77-65871263f6e3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.744886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-7c19afe2-8877-4845-ba77-65871263f6e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:09.744886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:18:09.744886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:18:09.746256 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19afe2-8877-4845-ba77-65871263f6e3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.749511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ac713-0a00-417c-9f08-d837cac664ec admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.754158 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b41328-bbf9-41e5-a687-3984251dcc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.755321 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41328-bbf9-41e5-a687-3984251dcc38 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.755604 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41328-bbf9-41e5-a687-3984251dcc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.755889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b41328-bbf9-41e5-a687-3984251dcc38 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.756784 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b41328-bbf9-41e5-a687-3984251dcc38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.756930 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b41328-bbf9-41e5-a687-3984251dcc38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.758577 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b41328-bbf9-41e5-a687-3984251dcc38 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.772727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 205/409] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:09.778851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b41328-bbf9-41e5-a687-3984251dcc38 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.791738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b41328-bbf9-41e5-a687-3984251dcc38 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.797676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663e6fa-700b-4880-9d5b-73f46beacd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.798577 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663e6fa-700b-4880-9d5b-73f46beacd3f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.798860 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663e6fa-700b-4880-9d5b-73f46beacd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.799189 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663e6fa-700b-4880-9d5b-73f46beacd3f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.800994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 205/410] 10.222.0.16 () {56 vars in 1159 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:09.808203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663e6fa-700b-4880-9d5b-73f46beacd3f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.809179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19afe2-8877-4845-ba77-65871263f6e3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.810417 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663e6fa-700b-4880-9d5b-73f46beacd3f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.820343 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19afe2-8877-4845-ba77-65871263f6e3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.824997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc81c1b-5a6e-45c9-a507-54b3253891ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.825770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc81c1b-5a6e-45c9-a507-54b3253891ab admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.826080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-1663e6fa-700b-4880-9d5b-73f46beacd3f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:09.826281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc81c1b-5a6e-45c9-a507-54b3253891ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.826674 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc81c1b-5a6e-45c9-a507-54b3253891ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.827530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 206/411] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:09.833620 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663e6fa-700b-4880-9d5b-73f46beacd3f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.837302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc81c1b-5a6e-45c9-a507-54b3253891ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.839225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc81c1b-5a6e-45c9-a507-54b3253891ab admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.843707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663e6fa-700b-4880-9d5b-73f46beacd3f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.848372 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fbf1f-0659-4572-982b-19dfe4bd0333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.848678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 206/412] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:18:09.849140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fbf1f-0659-4572-982b-19dfe4bd0333 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.849429 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fbf1f-0659-4572-982b-19dfe4bd0333 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.849764 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fbf1f-0659-4572-982b-19dfe4bd0333 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.850727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fbf1f-0659-4572-982b-19dfe4bd0333 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.850941 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fbf1f-0659-4572-982b-19dfe4bd0333 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.852982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fbf1f-0659-4572-982b-19dfe4bd0333 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.854984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc81c1b-5a6e-45c9-a507-54b3253891ab admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.864372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc81c1b-5a6e-45c9-a507-54b3253891ab admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.867603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 207/413] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:09.873604 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e98ae-f907-45ae-8fe6-06391d6a075f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.873887 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fbf1f-0659-4572-982b-19dfe4bd0333 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.874815 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e98ae-f907-45ae-8fe6-06391d6a075f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.875204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e98ae-f907-45ae-8fe6-06391d6a075f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.875620 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e98ae-f907-45ae-8fe6-06391d6a075f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.884459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fbf1f-0659-4572-982b-19dfe4bd0333 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.888068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e98ae-f907-45ae-8fe6-06391d6a075f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.889279 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7eaff-99c2-432b-a810-afaeeacc6c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.889954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7eaff-99c2-432b-a810-afaeeacc6c9e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.890239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7eaff-99c2-432b-a810-afaeeacc6c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.890475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e98ae-f907-45ae-8fe6-06391d6a075f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.890580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7eaff-99c2-432b-a810-afaeeacc6c9e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.891525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7eaff-99c2-432b-a810-afaeeacc6c9e admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=db83070471e34df695b571cdab440b1b) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.891838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7eaff-99c2-432b-a810-afaeeacc6c9e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.893691 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7eaff-99c2-432b-a810-afaeeacc6c9e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.899578 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 208/414] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/role_assignments?user.id=db83070471e34df695b571cdab440b1b&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:09.909157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-365e98ae-f907-45ae-8fe6-06391d6a075f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:09.916736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 207/415] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:09.918202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7eaff-99c2-432b-a810-afaeeacc6c9e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.932858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7eaff-99c2-432b-a810-afaeeacc6c9e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:09.946794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6d975-964f-4b91-87e3-aa2cf0860b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:09.947532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6d975-964f-4b91-87e3-aa2cf0860b1f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:09.947818 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6d975-964f-4b91-87e3-aa2cf0860b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:09.948097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6d975-964f-4b91-87e3-aa2cf0860b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:09.948836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6d975-964f-4b91-87e3-aa2cf0860b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:09.949144 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6d975-964f-4b91-87e3-aa2cf0860b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:09.951453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6d975-964f-4b91-87e3-aa2cf0860b1f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:09.970063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 209/416] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:09.976922 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e98ae-f907-45ae-8fe6-06391d6a075f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:09.992152 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e98ae-f907-45ae-8fe6-06391d6a075f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.002586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657a40a-d525-4c8f-8801-0e026531976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.003397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657a40a-d525-4c8f-8801-0e026531976b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.003814 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657a40a-d525-4c8f-8801-0e026531976b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.004090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657a40a-d525-4c8f-8801-0e026531976b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.012021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657a40a-d525-4c8f-8801-0e026531976b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.013999 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657a40a-d525-4c8f-8801-0e026531976b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.028347 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-4657a40a-d525-4c8f-8801-0e026531976b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:10.033971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 208/417] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:10.036885 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6d975-964f-4b91-87e3-aa2cf0860b1f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.047083 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6d975-964f-4b91-87e3-aa2cf0860b1f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.052474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf6082-c73f-4f08-853a-682ea17fe8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.053123 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf6082-c73f-4f08-853a-682ea17fe8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.053404 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf6082-c73f-4f08-853a-682ea17fe8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.053681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf6082-c73f-4f08-853a-682ea17fe8e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.054538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf6082-c73f-4f08-853a-682ea17fe8e5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:10.054847 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf6082-c73f-4f08-853a-682ea17fe8e5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.056723 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf6082-c73f-4f08-853a-682ea17fe8e5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.070048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 210/418] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:10.079489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657a40a-d525-4c8f-8801-0e026531976b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.090025 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657a40a-d525-4c8f-8801-0e026531976b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.094719 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be96b9c-801a-4b4f-857c-f383ca814652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.095392 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be96b9c-801a-4b4f-857c-f383ca814652 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.095721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be96b9c-801a-4b4f-857c-f383ca814652 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.095997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be96b9c-801a-4b4f-857c-f383ca814652 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.096884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be96b9c-801a-4b4f-857c-f383ca814652 admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=9ca81ff9c3114e8c9379418956063bb2) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:10.097231 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be96b9c-801a-4b4f-857c-f383ca814652 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.099699 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be96b9c-801a-4b4f-857c-f383ca814652 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.106310 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 209/419] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/role_assignments?user.id=9ca81ff9c3114e8c9379418956063bb2&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:10.236576 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a15222-52af-454c-a991-e75ac2c4886a None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.237026 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a15222-52af-454c-a991-e75ac2c4886a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.237386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a15222-52af-454c-a991-e75ac2c4886a None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.239422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 211/420] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:10.246145 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed8ac5-7fea-4be1-acf4-c67f1aebbc57 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.246414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed8ac5-7fea-4be1-acf4-c67f1aebbc57 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.246610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed8ac5-7fea-4be1-acf4-c67f1aebbc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.271873 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-94ed8ac5-7fea-4be1-acf4-c67f1aebbc57 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:10.273056 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-94ed8ac5-7fea-4be1-acf4-c67f1aebbc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:10.285030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 210/421] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:10.321767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a15222-52af-454c-a991-e75ac2c4886a None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.336196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a15222-52af-454c-a991-e75ac2c4886a None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.340792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1c5d5-2112-4dbc-ad85-71b6e7c96951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.341651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c5d5-2112-4dbc-ad85-71b6e7c96951 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.341989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c5d5-2112-4dbc-ad85-71b6e7c96951 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.342239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c5d5-2112-4dbc-ad85-71b6e7c96951 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.353149 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1c5d5-2112-4dbc-ad85-71b6e7c96951 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:10.360206 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-e0b1c5d5-2112-4dbc-ad85-71b6e7c96951 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:10.361514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 212/422] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:10.368827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed8ac5-7fea-4be1-acf4-c67f1aebbc57 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.378227 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed8ac5-7fea-4be1-acf4-c67f1aebbc57 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.383716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439c8e4-91c9-4bc5-ad49-40dfbc088ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.384401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439c8e4-91c9-4bc5-ad49-40dfbc088ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.384988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439c8e4-91c9-4bc5-ad49-40dfbc088ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.385269 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439c8e4-91c9-4bc5-ad49-40dfbc088ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.386100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439c8e4-91c9-4bc5-ad49-40dfbc088ec1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:10.386409 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439c8e4-91c9-4bc5-ad49-40dfbc088ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.388147 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439c8e4-91c9-4bc5-ad49-40dfbc088ec1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.398042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 211/423] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:10.404037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1c5d5-2112-4dbc-ad85-71b6e7c96951 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.415322 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1c5d5-2112-4dbc-ad85-71b6e7c96951 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.420156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef72dfa-d834-476e-8d5a-478ff7295b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.420976 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef72dfa-d834-476e-8d5a-478ff7295b5e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.421266 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef72dfa-d834-476e-8d5a-478ff7295b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.421544 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef72dfa-d834-476e-8d5a-478ff7295b5e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.433263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef72dfa-d834-476e-8d5a-478ff7295b5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.435205 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef72dfa-d834-476e-8d5a-478ff7295b5e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.459576 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-6ef72dfa-d834-476e-8d5a-478ff7295b5e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:10.460961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 213/424] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:10.466997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439c8e4-91c9-4bc5-ad49-40dfbc088ec1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.477129 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439c8e4-91c9-4bc5-ad49-40dfbc088ec1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.481820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d0ee1-6e05-49ed-bf13-4638a5f7103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.482542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d0ee1-6e05-49ed-bf13-4638a5f7103e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.482825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d0ee1-6e05-49ed-bf13-4638a5f7103e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.483104 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d0ee1-6e05-49ed-bf13-4638a5f7103e admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.483860 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d0ee1-6e05-49ed-bf13-4638a5f7103e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:10.484166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d0ee1-6e05-49ed-bf13-4638a5f7103e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.485756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d0ee1-6e05-49ed-bf13-4638a5f7103e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.499160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 212/425] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:10.506189 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef72dfa-d834-476e-8d5a-478ff7295b5e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.516891 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef72dfa-d834-476e-8d5a-478ff7295b5e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.526258 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887520f2-ae1e-4343-8e87-0a493adf3d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.527173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887520f2-ae1e-4343-8e87-0a493adf3d05 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.527453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887520f2-ae1e-4343-8e87-0a493adf3d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.527739 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887520f2-ae1e-4343-8e87-0a493adf3d05 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.539074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887520f2-ae1e-4343-8e87-0a493adf3d05 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.541337 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887520f2-ae1e-4343-8e87-0a493adf3d05 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.558031 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-887520f2-ae1e-4343-8e87-0a493adf3d05 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 14:18:10.559589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 214/426] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/users/neutron => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:10.565853 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d0ee1-6e05-49ed-bf13-4638a5f7103e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.578955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d0ee1-6e05-49ed-bf13-4638a5f7103e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.584205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f69274-e085-4906-8261-a58da977c6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.584923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f69274-e085-4906-8261-a58da977c6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.585213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f69274-e085-4906-8261-a58da977c6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.585491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f69274-e085-4906-8261-a58da977c6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.586424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f69274-e085-4906-8261-a58da977c6a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:10.586734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f69274-e085-4906-8261-a58da977c6a5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.588709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f69274-e085-4906-8261-a58da977c6a5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.614768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 213/427] 10.222.0.16 () {56 vars in 1161 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:10.621212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887520f2-ae1e-4343-8e87-0a493adf3d05 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.635555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887520f2-ae1e-4343-8e87-0a493adf3d05 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.640362 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0ef98-9479-4eb7-920f-a8ce64ae4eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.641074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0ef98-9479-4eb7-920f-a8ce64ae4eba admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.641365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0ef98-9479-4eb7-920f-a8ce64ae4eba admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.641642 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0ef98-9479-4eb7-920f-a8ce64ae4eba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.651411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0ef98-9479-4eb7-920f-a8ce64ae4eba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.653177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0ef98-9479-4eb7-920f-a8ce64ae4eba admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.665820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 215/428] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:10.671928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f69274-e085-4906-8261-a58da977c6a5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.684454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f69274-e085-4906-8261-a58da977c6a5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.693176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5db0d-c265-4056-9314-7f5e84436762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.694252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5db0d-c265-4056-9314-7f5e84436762 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.694760 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5db0d-c265-4056-9314-7f5e84436762 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.695224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5db0d-c265-4056-9314-7f5e84436762 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.702836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffccc7-7292-4514-9b63-ffb7ddf3f944 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.703132 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffccc7-7292-4514-9b63-ffb7ddf3f944 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.703409 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffccc7-7292-4514-9b63-ffb7ddf3f944 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.705407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 216/429] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:10.713568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782ab32-a5f1-49f9-b738-3372f6dfbcad None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.713952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782ab32-a5f1-49f9-b738-3372f6dfbcad None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.714308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782ab32-a5f1-49f9-b738-3372f6dfbcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.715976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5db0d-c265-4056-9314-7f5e84436762 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.718157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5db0d-c265-4056-9314-7f5e84436762 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.741657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-b782ab32-a5f1-49f9-b738-3372f6dfbcad None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:10.747052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b782ab32-a5f1-49f9-b738-3372f6dfbcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:10.749244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-95c5db0d-c265-4056-9314-7f5e84436762 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:10.750585 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 214/430] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:10.756702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5db0d-c265-4056-9314-7f5e84436762 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.766086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 217/431] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:10.768538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5db0d-c265-4056-9314-7f5e84436762 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.773491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb1e69-67f5-4b5c-93b1-0b94d5c8ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.774265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb1e69-67f5-4b5c-93b1-0b94d5c8ee66 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.774587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb1e69-67f5-4b5c-93b1-0b94d5c8ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.774963 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb1e69-67f5-4b5c-93b1-0b94d5c8ee66 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.775777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb1e69-67f5-4b5c-93b1-0b94d5c8ee66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:10.776106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb1e69-67f5-4b5c-93b1-0b94d5c8ee66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.777804 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb1e69-67f5-4b5c-93b1-0b94d5c8ee66 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.791000 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 215/432] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:10.797110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782ab32-a5f1-49f9-b738-3372f6dfbcad None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.807459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782ab32-a5f1-49f9-b738-3372f6dfbcad None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.809057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb1e69-67f5-4b5c-93b1-0b94d5c8ee66 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.819602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9ef60-305e-4021-9dc0-4545c6b7ee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.820452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9ef60-305e-4021-9dc0-4545c6b7ee22 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.820733 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9ef60-305e-4021-9dc0-4545c6b7ee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.821061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9ef60-305e-4021-9dc0-4545c6b7ee22 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.826980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb1e69-67f5-4b5c-93b1-0b94d5c8ee66 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.834883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9ef60-305e-4021-9dc0-4545c6b7ee22 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.837467 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e71625-f4bd-4ba5-9820-c18639e003e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.838283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e71625-f4bd-4ba5-9820-c18639e003e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.839135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9ef60-305e-4021-9dc0-4545c6b7ee22 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.839709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e71625-f4bd-4ba5-9820-c18639e003e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.840038 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e71625-f4bd-4ba5-9820-c18639e003e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.861762 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e71625-f4bd-4ba5-9820-c18639e003e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.863642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e71625-f4bd-4ba5-9820-c18639e003e2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.866920 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-80d9ef60-305e-4021-9dc0-4545c6b7ee22 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:10.868140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 218/433] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:10.883195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9ef60-305e-4021-9dc0-4545c6b7ee22 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.893332 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-f6e71625-f4bd-4ba5-9820-c18639e003e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:10.894748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 216/434] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:10.898320 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9ef60-305e-4021-9dc0-4545c6b7ee22 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.901673 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e71625-f4bd-4ba5-9820-c18639e003e2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.908402 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db9be7-14a5-41ad-8438-9b4731650ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.909110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db9be7-14a5-41ad-8438-9b4731650ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.909396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db9be7-14a5-41ad-8438-9b4731650ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.909671 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db9be7-14a5-41ad-8438-9b4731650ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.910532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db9be7-14a5-41ad-8438-9b4731650ce5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:10.911432 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db9be7-14a5-41ad-8438-9b4731650ce5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.914535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db9be7-14a5-41ad-8438-9b4731650ce5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.919264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e71625-f4bd-4ba5-9820-c18639e003e2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.930291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1e89b-886f-4706-aeaa-fee875e1f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.931028 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1e89b-886f-4706-aeaa-fee875e1f150 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.931315 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1e89b-886f-4706-aeaa-fee875e1f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.931643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1e89b-886f-4706-aeaa-fee875e1f150 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.932375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1e89b-886f-4706-aeaa-fee875e1f150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:10.932685 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1e89b-886f-4706-aeaa-fee875e1f150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.936194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1e89b-886f-4706-aeaa-fee875e1f150 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.945936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 219/435] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:10.952258 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db9be7-14a5-41ad-8438-9b4731650ce5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.961369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 217/436] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:10.965135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db9be7-14a5-41ad-8438-9b4731650ce5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.968324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1e89b-886f-4706-aeaa-fee875e1f150 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:10.974586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59879f2-3db5-4d6a-a372-7a93595ee4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.975262 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59879f2-3db5-4d6a-a372-7a93595ee4ee admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.975540 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59879f2-3db5-4d6a-a372-7a93595ee4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.975810 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59879f2-3db5-4d6a-a372-7a93595ee4ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.976641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59879f2-3db5-4d6a-a372-7a93595ee4ee admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=f13a39de23f04cb0a2f5b050d740334a) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:10.976951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59879f2-3db5-4d6a-a372-7a93595ee4ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.978816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59879f2-3db5-4d6a-a372-7a93595ee4ee admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:10.981275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1e89b-886f-4706-aeaa-fee875e1f150 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:10.992442 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 220/437] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:10 2021] GET /identity/v3/role_assignments?user.id=f13a39de23f04cb0a2f5b050d740334a&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:10.993714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b5e0-1bc2-4b81-b136-db45c3ced9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:10.994618 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b5e0-1bc2-4b81-b136-db45c3ced9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:10.995004 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b5e0-1bc2-4b81-b136-db45c3ced9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:10.995433 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b5e0-1bc2-4b81-b136-db45c3ced9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:10.996340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b5e0-1bc2-4b81-b136-db45c3ced9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:10.998627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b5e0-1bc2-4b81-b136-db45c3ced9a4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:11.086551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 218/438] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:18:10 2021] POST /identity/v3/users => generated 247 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:12.199420 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2861cb6-8316-4ca0-8cc4-365d9b04ee88 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.199957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2861cb6-8316-4ca0-8cc4-365d9b04ee88 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.199957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2861cb6-8316-4ca0-8cc4-365d9b04ee88 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.201736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 221/439] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:12.208740 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94035883-16c1-4b41-ad41-fc44482f9691 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.209196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94035883-16c1-4b41-ad41-fc44482f9691 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.209196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94035883-16c1-4b41-ad41-fc44482f9691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.242959 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-94035883-16c1-4b41-ad41-fc44482f9691 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:12.244183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-94035883-16c1-4b41-ad41-fc44482f9691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:12.252331 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 219/440] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:12.293042 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2861cb6-8316-4ca0-8cc4-365d9b04ee88 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.311684 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2861cb6-8316-4ca0-8cc4-365d9b04ee88 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.316152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d3c84-3234-45e4-9706-38b844ae5b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.316984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3c84-3234-45e4-9706-38b844ae5b0c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.317299 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3c84-3234-45e4-9706-38b844ae5b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.317505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d3c84-3234-45e4-9706-38b844ae5b0c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.332161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d3c84-3234-45e4-9706-38b844ae5b0c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:12.339143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-d28d3c84-3234-45e4-9706-38b844ae5b0c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:12.340726 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 222/441] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:12.347005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94035883-16c1-4b41-ad41-fc44482f9691 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.357229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94035883-16c1-4b41-ad41-fc44482f9691 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.365719 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ecfad-f807-4d59-acfe-febb5cc1a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.366429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ecfad-f807-4d59-acfe-febb5cc1a3fc admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.366710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ecfad-f807-4d59-acfe-febb5cc1a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.366985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ecfad-f807-4d59-acfe-febb5cc1a3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.367742 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ecfad-f807-4d59-acfe-febb5cc1a3fc admin admin] RBAC: Adding query filter params (name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:12.368042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ecfad-f807-4d59-acfe-febb5cc1a3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:12.369664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ecfad-f807-4d59-acfe-febb5cc1a3fc admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:12.378806 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 220/442] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:12.385908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d3c84-3234-45e4-9706-38b844ae5b0c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.396579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d3c84-3234-45e4-9706-38b844ae5b0c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.406157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27884228-33da-4d0f-862d-76418b9af67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.406971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27884228-33da-4d0f-862d-76418b9af67e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.407220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27884228-33da-4d0f-862d-76418b9af67e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.407494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27884228-33da-4d0f-862d-76418b9af67e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.419270 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27884228-33da-4d0f-862d-76418b9af67e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:12.421171 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27884228-33da-4d0f-862d-76418b9af67e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:12.443985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-27884228-33da-4d0f-862d-76418b9af67e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:12.450013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 223/443] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:12.451216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ecfad-f807-4d59-acfe-febb5cc1a3fc admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.461225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ecfad-f807-4d59-acfe-febb5cc1a3fc admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.469995 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34169b-4d73-480d-920e-4d5bad920a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.470657 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34169b-4d73-480d-920e-4d5bad920a1a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.470937 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34169b-4d73-480d-920e-4d5bad920a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.471210 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34169b-4d73-480d-920e-4d5bad920a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.471932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34169b-4d73-480d-920e-4d5bad920a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:12.472325 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34169b-4d73-480d-920e-4d5bad920a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:12.474532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34169b-4d73-480d-920e-4d5bad920a1a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:12.490410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 221/444] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:12.496641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27884228-33da-4d0f-862d-76418b9af67e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.507187 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27884228-33da-4d0f-862d-76418b9af67e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.518154 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22626f-3d12-430f-805f-999d183e1b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.518964 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22626f-3d12-430f-805f-999d183e1b84 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.519245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22626f-3d12-430f-805f-999d183e1b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.519518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22626f-3d12-430f-805f-999d183e1b84 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.528623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22626f-3d12-430f-805f-999d183e1b84 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:12.530712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22626f-3d12-430f-805f-999d183e1b84 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:12.555167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-ac22626f-3d12-430f-805f-999d183e1b84 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 14:18:12.556710 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 224/445] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:12.563202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34169b-4d73-480d-920e-4d5bad920a1a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.576569 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34169b-4d73-480d-920e-4d5bad920a1a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.590606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f2b11-8774-4a26-b51f-c4e12185eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.591353 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f2b11-8774-4a26-b51f-c4e12185eb31 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.591647 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f2b11-8774-4a26-b51f-c4e12185eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.591930 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f2b11-8774-4a26-b51f-c4e12185eb31 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.592779 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f2b11-8774-4a26-b51f-c4e12185eb31 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:12.593089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f2b11-8774-4a26-b51f-c4e12185eb31 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:12.595098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f2b11-8774-4a26-b51f-c4e12185eb31 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:12.622747 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 222/446] 10.222.0.16 () {56 vars in 1155 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:12.629013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22626f-3d12-430f-805f-999d183e1b84 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.642915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22626f-3d12-430f-805f-999d183e1b84 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.654046 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8966c-f37f-4521-95d7-725adab07f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.655117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8966c-f37f-4521-95d7-725adab07f9c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.655612 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8966c-f37f-4521-95d7-725adab07f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.656099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8966c-f37f-4521-95d7-725adab07f9c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.660032 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273ab28-1d19-4295-add1-d1cf21a8274b None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.660329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273ab28-1d19-4295-add1-d1cf21a8274b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.661282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273ab28-1d19-4295-add1-d1cf21a8274b None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.663418 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 223/447] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:12.669245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7aa08-bf89-45fc-9df3-9bedeb600223 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.669532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7aa08-bf89-45fc-9df3-9bedeb600223 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.669809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7aa08-bf89-45fc-9df3-9bedeb600223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.673541 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8966c-f37f-4521-95d7-725adab07f9c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:12.681502 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8966c-f37f-4521-95d7-725adab07f9c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:12.705267 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-96f7aa08-bf89-45fc-9df3-9bedeb600223 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:12.706502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-96f7aa08-bf89-45fc-9df3-9bedeb600223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:12.709151 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-a5f8966c-f37f-4521-95d7-725adab07f9c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:12.710950 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 225/448] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:12.717422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8966c-f37f-4521-95d7-725adab07f9c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.725354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 224/449] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 14:18:12.733899 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8966c-f37f-4521-95d7-725adab07f9c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.745555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2081-7e31-4126-be3a-b33378ae8def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.746615 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2081-7e31-4126-be3a-b33378ae8def admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.747117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2081-7e31-4126-be3a-b33378ae8def admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.747587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2081-7e31-4126-be3a-b33378ae8def admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.748516 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f2081-7e31-4126-be3a-b33378ae8def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:12.749040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f2081-7e31-4126-be3a-b33378ae8def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:12.750867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f2081-7e31-4126-be3a-b33378ae8def admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:12.771440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 226/450] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:12.777721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7aa08-bf89-45fc-9df3-9bedeb600223 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.783438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2081-7e31-4126-be3a-b33378ae8def admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.794132 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2081-7e31-4126-be3a-b33378ae8def admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.798248 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7aa08-bf89-45fc-9df3-9bedeb600223 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.799275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb22de-816f-4ba5-9bec-a557957cbfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.800297 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb22de-816f-4ba5-9bec-a557957cbfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.800795 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb22de-816f-4ba5-9bec-a557957cbfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.801385 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb22de-816f-4ba5-9bec-a557957cbfc3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.809895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2911d9-55e4-4f26-b260-4cefd0d66757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.810700 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2911d9-55e4-4f26-b260-4cefd0d66757 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.810987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2911d9-55e4-4f26-b260-4cefd0d66757 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.811260 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2911d9-55e4-4f26-b260-4cefd0d66757 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.813387 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb22de-816f-4ba5-9bec-a557957cbfc3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:12.818895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2911d9-55e4-4f26-b260-4cefd0d66757 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:12.820852 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2911d9-55e4-4f26-b260-4cefd0d66757 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:12.821248 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-73cb22de-816f-4ba5-9bec-a557957cbfc3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:12.822956 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 227/451] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:12.829454 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e8e4d-216a-4d5c-a98f-488290e8154c None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.830010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e8e4d-216a-4d5c-a98f-488290e8154c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.830474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e8e4d-216a-4d5c-a98f-488290e8154c None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.833744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 228/452] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:12 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:12.834704 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e8e4d-216a-4d5c-a98f-488290e8154c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.835615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-9e2911d9-55e4-4f26-b260-4cefd0d66757 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:12.837195 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 225/453] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:12.843960 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27395678-616b-4521-94e3-de9fe3808408 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.844247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27395678-616b-4521-94e3-de9fe3808408 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.844528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27395678-616b-4521-94e3-de9fe3808408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.849706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e8e4d-216a-4d5c-a98f-488290e8154c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.859873 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7b75c-c913-4a3e-ae3a-ae273d859484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.860529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7b75c-c913-4a3e-ae3a-ae273d859484 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.860810 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7b75c-c913-4a3e-ae3a-ae273d859484 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.861078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7b75c-c913-4a3e-ae3a-ae273d859484 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.861821 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7b75c-c913-4a3e-ae3a-ae273d859484 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:12.862154 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7b75c-c913-4a3e-ae3a-ae273d859484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:12.863775 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7b75c-c913-4a3e-ae3a-ae273d859484 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:12.865060 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-27395678-616b-4521-94e3-de9fe3808408 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:12.866528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-27395678-616b-4521-94e3-de9fe3808408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:12.873093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 229/454] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:12.874256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7b75c-c913-4a3e-ae3a-ae273d859484 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.879751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 226/455] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:12.881049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27395678-616b-4521-94e3-de9fe3808408 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.884663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7b75c-c913-4a3e-ae3a-ae273d859484 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.890268 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62c75e-0355-41c4-bde8-9844a0f58c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.891109 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62c75e-0355-41c4-bde8-9844a0f58c59 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.891369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27395678-616b-4521-94e3-de9fe3808408 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.891746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62c75e-0355-41c4-bde8-9844a0f58c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.892210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62c75e-0355-41c4-bde8-9844a0f58c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.893261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62c75e-0355-41c4-bde8-9844a0f58c59 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:12.893798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62c75e-0355-41c4-bde8-9844a0f58c59 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:12.896739 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62c75e-0355-41c4-bde8-9844a0f58c59 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:12.896888 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5ebb-0cfb-400b-aab1-6b04b1353327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.897803 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5ebb-0cfb-400b-aab1-6b04b1353327 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.898207 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5ebb-0cfb-400b-aab1-6b04b1353327 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.898586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5ebb-0cfb-400b-aab1-6b04b1353327 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.909169 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f5ebb-0cfb-400b-aab1-6b04b1353327 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:12.913981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f5ebb-0cfb-400b-aab1-6b04b1353327 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:12.917685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 230/456] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:12.923033 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62c75e-0355-41c4-bde8-9844a0f58c59 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.940892 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-e45f5ebb-0cfb-400b-aab1-6b04b1353327 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:12.941494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62c75e-0355-41c4-bde8-9844a0f58c59 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.943354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 227/457] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:12.944341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5ebb-0cfb-400b-aab1-6b04b1353327 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:12.958715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916ca70-2da0-404a-8ae5-c321ef80a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.959690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916ca70-2da0-404a-8ae5-c321ef80a0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.960091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916ca70-2da0-404a-8ae5-c321ef80a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.960305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5ebb-0cfb-400b-aab1-6b04b1353327 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:12.960447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916ca70-2da0-404a-8ae5-c321ef80a0a7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.971846 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48414872-9db0-4874-863c-abc9ab812000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:12.973007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48414872-9db0-4874-863c-abc9ab812000 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:12.973461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48414872-9db0-4874-863c-abc9ab812000 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:12.973949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48414872-9db0-4874-863c-abc9ab812000 admin admin] PATH_INFO: `/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/d8c0afa8f09f4923b9c8ab2696156129/roles/ac37a5f3e1454b8f929c2419c3e148cb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:12.979621 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916ca70-2da0-404a-8ae5-c321ef80a0a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:12.990128 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-3916ca70-2da0-404a-8ae5-c321ef80a0a7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:12.991262 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48414872-9db0-4874-863c-abc9ab812000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c728e9160de45afbd4902c27eef45b3, user_id=d8c0afa8f09f4923b9c8ab2696156129, role_id=ac37a5f3e1454b8f929c2419c3e148cb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:12.997085 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 231/458] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:12.997085 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916ca70-2da0-404a-8ae5-c321ef80a0a7 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.001144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48414872-9db0-4874-863c-abc9ab812000 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.002494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916ca70-2da0-404a-8ae5-c321ef80a0a7 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.008692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30835d-7f91-4853-8e5b-58372bda59cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.009685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30835d-7f91-4853-8e5b-58372bda59cb admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.010033 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30835d-7f91-4853-8e5b-58372bda59cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.010311 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30835d-7f91-4853-8e5b-58372bda59cb admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.011029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30835d-7f91-4853-8e5b-58372bda59cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:13.011330 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30835d-7f91-4853-8e5b-58372bda59cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.012922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30835d-7f91-4853-8e5b-58372bda59cb admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.025622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 232/459] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:13.029922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30835d-7f91-4853-8e5b-58372bda59cb admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.039629 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30835d-7f91-4853-8e5b-58372bda59cb admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.044027 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02ffe0-be3c-4b54-84c6-f10b91479d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.044676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02ffe0-be3c-4b54-84c6-f10b91479d98 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.049267 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02ffe0-be3c-4b54-84c6-f10b91479d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.049267 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02ffe0-be3c-4b54-84c6-f10b91479d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.049267 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02ffe0-be3c-4b54-84c6-f10b91479d98 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:13.049267 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02ffe0-be3c-4b54-84c6-f10b91479d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.049267 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02ffe0-be3c-4b54-84c6-f10b91479d98 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.061058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 233/460] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:13.061058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02ffe0-be3c-4b54-84c6-f10b91479d98 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.071280 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02ffe0-be3c-4b54-84c6-f10b91479d98 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.075887 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81449ca3-dd0e-4aab-bcdb-abaa28580b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.076720 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81449ca3-dd0e-4aab-bcdb-abaa28580b87 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.076982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81449ca3-dd0e-4aab-bcdb-abaa28580b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.077259 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81449ca3-dd0e-4aab-bcdb-abaa28580b87 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.086908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81449ca3-dd0e-4aab-bcdb-abaa28580b87 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.089012 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81449ca3-dd0e-4aab-bcdb-abaa28580b87 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.094147 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 228/461] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:18:12 2021] PUT /identity/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/d8c0afa8f09f4923b9c8ab2696156129/roles/ac37a5f3e1454b8f929c2419c3e148cb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:18:13.095595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48414872-9db0-4874-863c-abc9ab812000 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.113285 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-81449ca3-dd0e-4aab-bcdb-abaa28580b87 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 14:18:13.114708 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 234/462] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/users/glance => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:13.133774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81449ca3-dd0e-4aab-bcdb-abaa28580b87 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.160384 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81449ca3-dd0e-4aab-bcdb-abaa28580b87 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.177655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48414872-9db0-4874-863c-abc9ab812000 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.183868 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a658-96bd-4b3d-9be7-7bdac2b125e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.185183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a658-96bd-4b3d-9be7-7bdac2b125e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.185674 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a658-96bd-4b3d-9be7-7bdac2b125e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.186147 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a658-96bd-4b3d-9be7-7bdac2b125e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.199899 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792a658-96bd-4b3d-9be7-7bdac2b125e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.202399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792a658-96bd-4b3d-9be7-7bdac2b125e1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.223589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-7792a658-96bd-4b3d-9be7-7bdac2b125e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:13.225641 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 229/463] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:13.232199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a658-96bd-4b3d-9be7-7bdac2b125e1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.243189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a658-96bd-4b3d-9be7-7bdac2b125e1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.248091 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9030209-bc19-4041-a42f-c2b8ee29b185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.248943 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9030209-bc19-4041-a42f-c2b8ee29b185 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.249366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9030209-bc19-4041-a42f-c2b8ee29b185 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.249781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9030209-bc19-4041-a42f-c2b8ee29b185 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.250720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9030209-bc19-4041-a42f-c2b8ee29b185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:13.251159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9030209-bc19-4041-a42f-c2b8ee29b185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.252919 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9030209-bc19-4041-a42f-c2b8ee29b185 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.270633 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 230/464] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:13.273547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9030209-bc19-4041-a42f-c2b8ee29b185 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.283879 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9030209-bc19-4041-a42f-c2b8ee29b185 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.288787 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e113fd-43e7-4f7d-96df-453c138072c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.289797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e113fd-43e7-4f7d-96df-453c138072c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.290242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e113fd-43e7-4f7d-96df-453c138072c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.290649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e113fd-43e7-4f7d-96df-453c138072c9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.299578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e113fd-43e7-4f7d-96df-453c138072c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.302460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e113fd-43e7-4f7d-96df-453c138072c9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.317736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-84e113fd-43e7-4f7d-96df-453c138072c9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 14:18:13.324911 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 231/465] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:13.326720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e113fd-43e7-4f7d-96df-453c138072c9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.330848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2c600-523f-4db6-8a6b-622a039ce842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.331651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2c600-523f-4db6-8a6b-622a039ce842 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.331935 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2c600-523f-4db6-8a6b-622a039ce842 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.332208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2c600-523f-4db6-8a6b-622a039ce842 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.333144 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2c600-523f-4db6-8a6b-622a039ce842 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:13.333431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2c600-523f-4db6-8a6b-622a039ce842 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.335435 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2c600-523f-4db6-8a6b-622a039ce842 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.338596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e113fd-43e7-4f7d-96df-453c138072c9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.343281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae63cf-bcc8-457e-ae13-df4303a3f7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.344179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae63cf-bcc8-457e-ae13-df4303a3f7ef admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.344605 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae63cf-bcc8-457e-ae13-df4303a3f7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.345023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae63cf-bcc8-457e-ae13-df4303a3f7ef admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.346039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae63cf-bcc8-457e-ae13-df4303a3f7ef admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:13.346486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae63cf-bcc8-457e-ae13-df4303a3f7ef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.349234 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae63cf-bcc8-457e-ae13-df4303a3f7ef admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.365907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 235/466] 10.222.0.16 () {56 vars in 1159 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:13.371849 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2c600-523f-4db6-8a6b-622a039ce842 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.381736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 232/467] 10.222.0.16 () {56 vars in 1159 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:13.389489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2c600-523f-4db6-8a6b-622a039ce842 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.389664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae63cf-bcc8-457e-ae13-df4303a3f7ef admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.395601 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b44465-2b51-476e-8e12-566e92a27904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.397096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b44465-2b51-476e-8e12-566e92a27904 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.397579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b44465-2b51-476e-8e12-566e92a27904 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.398063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b44465-2b51-476e-8e12-566e92a27904 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.402759 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae63cf-bcc8-457e-ae13-df4303a3f7ef admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.407478 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37501d-f92e-4cc4-badd-180fcbe269dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.409499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37501d-f92e-4cc4-badd-180fcbe269dc admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.409499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37501d-f92e-4cc4-badd-180fcbe269dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.409499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37501d-f92e-4cc4-badd-180fcbe269dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.412249 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b44465-2b51-476e-8e12-566e92a27904 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.415363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b44465-2b51-476e-8e12-566e92a27904 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.430147 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37501d-f92e-4cc4-badd-180fcbe269dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.432127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37501d-f92e-4cc4-badd-180fcbe269dc admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.440836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-87b44465-2b51-476e-8e12-566e92a27904 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:13.443547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 236/468] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:13.451668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b44465-2b51-476e-8e12-566e92a27904 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.458563 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-ec37501d-f92e-4cc4-badd-180fcbe269dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:13.460398 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 233/469] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:13.466741 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37501d-f92e-4cc4-badd-180fcbe269dc admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.477945 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b44465-2b51-476e-8e12-566e92a27904 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.482743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37501d-f92e-4cc4-badd-180fcbe269dc admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.487465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2c643-96ad-41ed-becd-1c2a127f41c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.488122 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2c643-96ad-41ed-becd-1c2a127f41c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.488404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2c643-96ad-41ed-becd-1c2a127f41c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.489453 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2c643-96ad-41ed-becd-1c2a127f41c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.490126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2c643-96ad-41ed-becd-1c2a127f41c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:13.490438 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2c643-96ad-41ed-becd-1c2a127f41c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.492149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2c643-96ad-41ed-becd-1c2a127f41c2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.492967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29175d00-eecc-48c1-8ab1-76a375a73df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.493853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29175d00-eecc-48c1-8ab1-76a375a73df9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.494333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29175d00-eecc-48c1-8ab1-76a375a73df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.494800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29175d00-eecc-48c1-8ab1-76a375a73df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.495539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29175d00-eecc-48c1-8ab1-76a375a73df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:13.498228 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29175d00-eecc-48c1-8ab1-76a375a73df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.499898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29175d00-eecc-48c1-8ab1-76a375a73df9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.506788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 234/470] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:13.522121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2c643-96ad-41ed-becd-1c2a127f41c2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.529853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 237/471] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:13.533297 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2c643-96ad-41ed-becd-1c2a127f41c2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.536659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29175d00-eecc-48c1-8ab1-76a375a73df9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.541190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c229921-c48b-4921-89b4-ca0099ed82d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.543729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c229921-c48b-4921-89b4-ca0099ed82d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.544209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c229921-c48b-4921-89b4-ca0099ed82d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.545608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c229921-c48b-4921-89b4-ca0099ed82d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.556037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c229921-c48b-4921-89b4-ca0099ed82d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.558477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c229921-c48b-4921-89b4-ca0099ed82d6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.562935 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29175d00-eecc-48c1-8ab1-76a375a73df9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.569785 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508656d-39c1-4bd3-b011-ff66450eb377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.570623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508656d-39c1-4bd3-b011-ff66450eb377 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.570958 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508656d-39c1-4bd3-b011-ff66450eb377 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.571236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508656d-39c1-4bd3-b011-ff66450eb377 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.575295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-0c229921-c48b-4921-89b4-ca0099ed82d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:13.576755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 235/472] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:13.578214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2069aa-f4a7-48e3-bfcb-f45a21056496 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.578711 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2069aa-f4a7-48e3-bfcb-f45a21056496 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.579177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2069aa-f4a7-48e3-bfcb-f45a21056496 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.581017 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 236/473] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:13.587162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508656d-39c1-4bd3-b011-ff66450eb377 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.587908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508656d-39c1-4bd3-b011-ff66450eb377 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.589071 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2069aa-f4a7-48e3-bfcb-f45a21056496 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.605583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-5508656d-39c1-4bd3-b011-ff66450eb377 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:13.606505 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2069aa-f4a7-48e3-bfcb-f45a21056496 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.607374 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 238/474] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:13.609182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c12fae-d89a-4e52-bf81-0eaa27f78cd7 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.609182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c12fae-d89a-4e52-bf81-0eaa27f78cd7 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.609397 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c12fae-d89a-4e52-bf81-0eaa27f78cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.617503 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650913e2-2c40-4ceb-a756-b3177103b0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.619458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650913e2-2c40-4ceb-a756-b3177103b0cd admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.619935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650913e2-2c40-4ceb-a756-b3177103b0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.620417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650913e2-2c40-4ceb-a756-b3177103b0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.621524 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650913e2-2c40-4ceb-a756-b3177103b0cd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:13.622048 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650913e2-2c40-4ceb-a756-b3177103b0cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.623304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-650913e2-2c40-4ceb-a756-b3177103b0cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:13.623304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:18:13.623304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:18:13.625405 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650913e2-2c40-4ceb-a756-b3177103b0cd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.630955 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-89c12fae-d89a-4e52-bf81-0eaa27f78cd7 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:13.632232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-89c12fae-d89a-4e52-bf81-0eaa27f78cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:13.642478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 239/475] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:13.643501 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c12fae-d89a-4e52-bf81-0eaa27f78cd7 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.653036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c12fae-d89a-4e52-bf81-0eaa27f78cd7 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.655791 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 237/476] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:13.663430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b15dfa-3265-4798-879d-02f01f8bfe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.664187 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650913e2-2c40-4ceb-a756-b3177103b0cd admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.664806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b15dfa-3265-4798-879d-02f01f8bfe6a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.665281 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b15dfa-3265-4798-879d-02f01f8bfe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.665750 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b15dfa-3265-4798-879d-02f01f8bfe6a admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.666828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b15dfa-3265-4798-879d-02f01f8bfe6a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:13.668161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b15dfa-3265-4798-879d-02f01f8bfe6a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.671621 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b15dfa-3265-4798-879d-02f01f8bfe6a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.674950 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650913e2-2c40-4ceb-a756-b3177103b0cd admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.686305 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 240/477] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:13.688342 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b15dfa-3265-4798-879d-02f01f8bfe6a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.689093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb5248-9dfe-4d01-ba76-c5aea31d95e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.690059 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb5248-9dfe-4d01-ba76-c5aea31d95e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.690341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb5248-9dfe-4d01-ba76-c5aea31d95e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.690610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb5248-9dfe-4d01-ba76-c5aea31d95e1 admin admin] PATH_INFO: `/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/9ca81ff9c3114e8c9379418956063bb2/roles/ac37a5f3e1454b8f929c2419c3e148cb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.707234 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b15dfa-3265-4798-879d-02f01f8bfe6a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.714770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb5248-9dfe-4d01-ba76-c5aea31d95e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c728e9160de45afbd4902c27eef45b3, user_id=9ca81ff9c3114e8c9379418956063bb2, role_id=ac37a5f3e1454b8f929c2419c3e148cb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.715342 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedea07-2ae5-417c-960d-50c30e3f56bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.716396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedea07-2ae5-417c-960d-50c30e3f56bd admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.716876 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedea07-2ae5-417c-960d-50c30e3f56bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.717357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedea07-2ae5-417c-960d-50c30e3f56bd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.717644 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb5248-9dfe-4d01-ba76-c5aea31d95e1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.730062 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedea07-2ae5-417c-960d-50c30e3f56bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:13.742067 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-3cedea07-2ae5-417c-960d-50c30e3f56bd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:13.746028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 241/478] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:13.746028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedea07-2ae5-417c-960d-50c30e3f56bd admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.762781 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedea07-2ae5-417c-960d-50c30e3f56bd admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.769147 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1564-1301-4d9b-94ae-ee1e83dbbda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.770721 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1564-1301-4d9b-94ae-ee1e83dbbda2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.771072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1564-1301-4d9b-94ae-ee1e83dbbda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.771417 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1564-1301-4d9b-94ae-ee1e83dbbda2 admin admin] PATH_INFO: `/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/db83070471e34df695b571cdab440b1b/roles/ac37a5f3e1454b8f929c2419c3e148cb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.788940 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d1564-1301-4d9b-94ae-ee1e83dbbda2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c728e9160de45afbd4902c27eef45b3, user_id=db83070471e34df695b571cdab440b1b, role_id=ac37a5f3e1454b8f929c2419c3e148cb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.793668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d1564-1301-4d9b-94ae-ee1e83dbbda2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.808375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 238/479] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:18:13 2021] PUT /identity/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/9ca81ff9c3114e8c9379418956063bb2/roles/ac37a5f3e1454b8f929c2419c3e148cb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:18:13.809890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb5248-9dfe-4d01-ba76-c5aea31d95e1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.891541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb5248-9dfe-4d01-ba76-c5aea31d95e1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.900146 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4cb38-c167-432f-bc7d-002185678bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:13.901228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4cb38-c167-432f-bc7d-002185678bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:13.901666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4cb38-c167-432f-bc7d-002185678bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:13.902105 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4cb38-c167-432f-bc7d-002185678bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:13.902991 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4cb38-c167-432f-bc7d-002185678bc5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:13.903485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4cb38-c167-432f-bc7d-002185678bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:13.905258 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4cb38-c167-432f-bc7d-002185678bc5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:13.916811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 239/480] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:13.925125 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4cb38-c167-432f-bc7d-002185678bc5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:13.938049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4cb38-c167-432f-bc7d-002185678bc5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:13.959911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 242/481] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:18:13 2021] PUT /identity/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/db83070471e34df695b571cdab440b1b/roles/ac37a5f3e1454b8f929c2419c3e148cb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:18:14.038716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6e68e-ce80-4f45-a44b-116bc04b9b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.039932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6e68e-ce80-4f45-a44b-116bc04b9b55 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.040412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6e68e-ce80-4f45-a44b-116bc04b9b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.040864 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6e68e-ce80-4f45-a44b-116bc04b9b55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.055768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6e68e-ce80-4f45-a44b-116bc04b9b55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.058057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6e68e-ce80-4f45-a44b-116bc04b9b55 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.080191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-5ff6e68e-ce80-4f45-a44b-116bc04b9b55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:14.085595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 240/482] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:14.091735 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1564-1301-4d9b-94ae-ee1e83dbbda2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.104507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1564-1301-4d9b-94ae-ee1e83dbbda2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.111340 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c015c1e-5e6e-4983-befc-171bcfab1ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.112328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015c1e-5e6e-4983-befc-171bcfab1ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.112786 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015c1e-5e6e-4983-befc-171bcfab1ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.113235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015c1e-5e6e-4983-befc-171bcfab1ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.114315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c015c1e-5e6e-4983-befc-171bcfab1ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:14.114803 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c015c1e-5e6e-4983-befc-171bcfab1ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.116979 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c015c1e-5e6e-4983-befc-171bcfab1ad8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.133858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 243/483] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:14.141267 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6e68e-ce80-4f45-a44b-116bc04b9b55 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.153785 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6e68e-ce80-4f45-a44b-116bc04b9b55 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.159925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387aed4-b093-42a5-866f-cf38232fd109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.162032 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387aed4-b093-42a5-866f-cf38232fd109 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.162660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387aed4-b093-42a5-866f-cf38232fd109 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.163195 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387aed4-b093-42a5-866f-cf38232fd109 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.172437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387aed4-b093-42a5-866f-cf38232fd109 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.175049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387aed4-b093-42a5-866f-cf38232fd109 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.192539 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-a387aed4-b093-42a5-866f-cf38232fd109 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 14:18:14.198429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 241/484] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:14.202501 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c015c1e-5e6e-4983-befc-171bcfab1ad8 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.215373 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c015c1e-5e6e-4983-befc-171bcfab1ad8 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.220650 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff8373-f02d-4ef0-8a7d-11e521ea6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.221751 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8373-f02d-4ef0-8a7d-11e521ea6be0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.222388 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8373-f02d-4ef0-8a7d-11e521ea6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.223004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8373-f02d-4ef0-8a7d-11e521ea6be0 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.225243 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff8373-f02d-4ef0-8a7d-11e521ea6be0 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:14.225788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff8373-f02d-4ef0-8a7d-11e521ea6be0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.227928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff8373-f02d-4ef0-8a7d-11e521ea6be0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.258000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 244/485] 10.222.0.16 () {56 vars in 1161 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:14.260520 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387aed4-b093-42a5-866f-cf38232fd109 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.276334 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387aed4-b093-42a5-866f-cf38232fd109 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.281344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727484af-aa07-4a1a-9458-3624d68153fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.282406 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727484af-aa07-4a1a-9458-3624d68153fe admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.282895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727484af-aa07-4a1a-9458-3624d68153fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.283566 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727484af-aa07-4a1a-9458-3624d68153fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.298822 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727484af-aa07-4a1a-9458-3624d68153fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.301070 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727484af-aa07-4a1a-9458-3624d68153fe admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.323949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-727484af-aa07-4a1a-9458-3624d68153fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:14.325475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 242/486] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:14.333242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff8373-f02d-4ef0-8a7d-11e521ea6be0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.347445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387b11d-835d-4736-8eb5-fb7a9133f49f None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.348163 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387b11d-835d-4736-8eb5-fb7a9133f49f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.348708 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387b11d-835d-4736-8eb5-fb7a9133f49f None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.350652 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff8373-f02d-4ef0-8a7d-11e521ea6be0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.350928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 243/487] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:14.357496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71704408-5799-43d3-80c8-552bc37c34f0 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.358027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71704408-5799-43d3-80c8-552bc37c34f0 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.358431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71704408-5799-43d3-80c8-552bc37c34f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.370591 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5277ed2-f7db-494f-9ee7-07b83904dd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.371419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5277ed2-f7db-494f-9ee7-07b83904dd23 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.371811 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5277ed2-f7db-494f-9ee7-07b83904dd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.372189 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5277ed2-f7db-494f-9ee7-07b83904dd23 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.373022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5277ed2-f7db-494f-9ee7-07b83904dd23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:14.373431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5277ed2-f7db-494f-9ee7-07b83904dd23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.375186 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5277ed2-f7db-494f-9ee7-07b83904dd23 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.379109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-71704408-5799-43d3-80c8-552bc37c34f0 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:14.381057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-71704408-5799-43d3-80c8-552bc37c34f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:14.394006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 244/488] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:14.402654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 245/489] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:14.409052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71704408-5799-43d3-80c8-552bc37c34f0 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.422852 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71704408-5799-43d3-80c8-552bc37c34f0 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.431136 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e381789-e668-4c75-a2ae-d79d87d6dcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.432116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e381789-e668-4c75-a2ae-d79d87d6dcec admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.432544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e381789-e668-4c75-a2ae-d79d87d6dcec admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.433005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e381789-e668-4c75-a2ae-d79d87d6dcec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.445038 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e381789-e668-4c75-a2ae-d79d87d6dcec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.447437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e381789-e668-4c75-a2ae-d79d87d6dcec admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.449188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5277ed2-f7db-494f-9ee7-07b83904dd23 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.461536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5277ed2-f7db-494f-9ee7-07b83904dd23 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.462299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-0e381789-e668-4c75-a2ae-d79d87d6dcec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:14.468928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 245/490] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:14.470219 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e381789-e668-4c75-a2ae-d79d87d6dcec admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.483139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e381789-e668-4c75-a2ae-d79d87d6dcec admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.488177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa2a63-d16e-4c3a-be05-20a6138a738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.489598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d908ae0-2032-4827-9e1c-9a5b2e387c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.489912 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa2a63-d16e-4c3a-be05-20a6138a738f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.490330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa2a63-d16e-4c3a-be05-20a6138a738f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.490738 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa2a63-d16e-4c3a-be05-20a6138a738f admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.490934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d908ae0-2032-4827-9e1c-9a5b2e387c0c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.491318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d908ae0-2032-4827-9e1c-9a5b2e387c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.491692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d908ae0-2032-4827-9e1c-9a5b2e387c0c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.492358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa2a63-d16e-4c3a-be05-20a6138a738f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:14.492865 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa2a63-d16e-4c3a-be05-20a6138a738f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.495051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa2a63-d16e-4c3a-be05-20a6138a738f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.510477 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d908ae0-2032-4827-9e1c-9a5b2e387c0c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:14.518740 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 246/491] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:14.521145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-4d908ae0-2032-4827-9e1c-9a5b2e387c0c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:14.522728 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 246/492] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:14.526251 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa2a63-d16e-4c3a-be05-20a6138a738f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.528665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d908ae0-2032-4827-9e1c-9a5b2e387c0c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.544801 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa2a63-d16e-4c3a-be05-20a6138a738f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.552572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d908ae0-2032-4827-9e1c-9a5b2e387c0c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.555848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbbf6b-5989-409f-9466-82d24dbb109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.556956 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbbf6b-5989-409f-9466-82d24dbb109e admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.557499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbbf6b-5989-409f-9466-82d24dbb109e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.557937 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbbf6b-5989-409f-9466-82d24dbb109e admin admin] PATH_INFO: `/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/f13a39de23f04cb0a2f5b050d740334a/roles/ac37a5f3e1454b8f929c2419c3e148cb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.564485 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbad6c-7bb6-4664-bc51-c5d3f53b5696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.565447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbad6c-7bb6-4664-bc51-c5d3f53b5696 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.567680 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbad6c-7bb6-4664-bc51-c5d3f53b5696 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.568149 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbad6c-7bb6-4664-bc51-c5d3f53b5696 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.570240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbad6c-7bb6-4664-bc51-c5d3f53b5696 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:14.570747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbad6c-7bb6-4664-bc51-c5d3f53b5696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.574778 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbad6c-7bb6-4664-bc51-c5d3f53b5696 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.588217 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbbf6b-5989-409f-9466-82d24dbb109e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c728e9160de45afbd4902c27eef45b3, user_id=f13a39de23f04cb0a2f5b050d740334a, role_id=ac37a5f3e1454b8f929c2419c3e148cb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.591148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbbf6b-5989-409f-9466-82d24dbb109e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.592876 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 247/493] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:14.600827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbad6c-7bb6-4664-bc51-c5d3f53b5696 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.620452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbad6c-7bb6-4664-bc51-c5d3f53b5696 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.625434 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0141d-6bef-44a8-92bf-416d70482c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.626560 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0141d-6bef-44a8-92bf-416d70482c6d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.626984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0141d-6bef-44a8-92bf-416d70482c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.627398 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0141d-6bef-44a8-92bf-416d70482c6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.638820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0141d-6bef-44a8-92bf-416d70482c6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.640943 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0141d-6bef-44a8-92bf-416d70482c6d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.658125 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-65f0141d-6bef-44a8-92bf-416d70482c6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:14.659812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 248/494] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:14.666158 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0141d-6bef-44a8-92bf-416d70482c6d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.675602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0141d-6bef-44a8-92bf-416d70482c6d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.680744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79052c3-e46b-4729-bc86-a3c54cbefc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.681428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79052c3-e46b-4729-bc86-a3c54cbefc01 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.681710 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79052c3-e46b-4729-bc86-a3c54cbefc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.682018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79052c3-e46b-4729-bc86-a3c54cbefc01 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.682822 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79052c3-e46b-4729-bc86-a3c54cbefc01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:14.683129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79052c3-e46b-4729-bc86-a3c54cbefc01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.684681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79052c3-e46b-4729-bc86-a3c54cbefc01 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.697250 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 249/495] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:14.699847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 247/496] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:18:14 2021] PUT /identity/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/f13a39de23f04cb0a2f5b050d740334a/roles/ac37a5f3e1454b8f929c2419c3e148cb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:18:14.705345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79052c3-e46b-4729-bc86-a3c54cbefc01 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.716824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79052c3-e46b-4729-bc86-a3c54cbefc01 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.799188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedd8cd-c94d-4ec2-8a2a-d75468d6e9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.800251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedd8cd-c94d-4ec2-8a2a-d75468d6e9ab admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.800674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedd8cd-c94d-4ec2-8a2a-d75468d6e9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.801119 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedd8cd-c94d-4ec2-8a2a-d75468d6e9ab admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.810971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedd8cd-c94d-4ec2-8a2a-d75468d6e9ab admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.813202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedd8cd-c94d-4ec2-8a2a-d75468d6e9ab admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.832801 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-7aedd8cd-c94d-4ec2-8a2a-d75468d6e9ab admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 14:18:14.837989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 250/497] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/users/swift => generated 83 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:14.840509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbbf6b-5989-409f-9466-82d24dbb109e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.852309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbbf6b-5989-409f-9466-82d24dbb109e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.867339 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f6f9-684f-4c54-b71f-0d43f96a7303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.868038 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f6f9-684f-4c54-b71f-0d43f96a7303 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.868319 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f6f9-684f-4c54-b71f-0d43f96a7303 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.868594 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003f6f9-684f-4c54-b71f-0d43f96a7303 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.869432 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003f6f9-684f-4c54-b71f-0d43f96a7303 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:14.869737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003f6f9-684f-4c54-b71f-0d43f96a7303 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.871628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003f6f9-684f-4c54-b71f-0d43f96a7303 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.899536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 248/498] 10.222.0.16 () {56 vars in 1157 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:14.905291 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedd8cd-c94d-4ec2-8a2a-d75468d6e9ab admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.919124 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedd8cd-c94d-4ec2-8a2a-d75468d6e9ab admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.928034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffad860-e181-4054-afae-7308f35f18cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.929360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffad860-e181-4054-afae-7308f35f18cf admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.929786 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffad860-e181-4054-afae-7308f35f18cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.930214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffad860-e181-4054-afae-7308f35f18cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:14.947157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffad860-e181-4054-afae-7308f35f18cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:14.949177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffad860-e181-4054-afae-7308f35f18cf admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:14.961976 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 251/499] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:14.967812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f6f9-684f-4c54-b71f-0d43f96a7303 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:14.983424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003f6f9-684f-4c54-b71f-0d43f96a7303 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:14.990066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec180ef-2093-401e-8ed3-dd1ec64ce5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:14.991090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec180ef-2093-401e-8ed3-dd1ec64ce5ae admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:14.991514 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec180ef-2093-401e-8ed3-dd1ec64ce5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:14.992035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec180ef-2093-401e-8ed3-dd1ec64ce5ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:15.004249 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec180ef-2093-401e-8ed3-dd1ec64ce5ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:15.006326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec180ef-2093-401e-8ed3-dd1ec64ce5ae admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:15.024427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-6ec180ef-2093-401e-8ed3-dd1ec64ce5ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:15.026184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 249/500] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:15.034984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffad860-e181-4054-afae-7308f35f18cf admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:15.044957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffad860-e181-4054-afae-7308f35f18cf admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:15.049643 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba1f86-dab4-4fb8-8fd0-7b4c556a2e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:15.050484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba1f86-dab4-4fb8-8fd0-7b4c556a2e5a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:15.050909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba1f86-dab4-4fb8-8fd0-7b4c556a2e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:15.051568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba1f86-dab4-4fb8-8fd0-7b4c556a2e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:15.052426 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba1f86-dab4-4fb8-8fd0-7b4c556a2e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:15.052890 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba1f86-dab4-4fb8-8fd0-7b4c556a2e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:15.054621 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba1f86-dab4-4fb8-8fd0-7b4c556a2e5a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:15.068848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 252/501] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:15.074518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec180ef-2093-401e-8ed3-dd1ec64ce5ae admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:15.085276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec180ef-2093-401e-8ed3-dd1ec64ce5ae admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:15.090140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5c0a8-fabe-4b9f-a783-0d3459cb11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:15.091096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5c0a8-fabe-4b9f-a783-0d3459cb11ee admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:15.091519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5c0a8-fabe-4b9f-a783-0d3459cb11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:15.091969 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5c0a8-fabe-4b9f-a783-0d3459cb11ee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:15.100366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5c0a8-fabe-4b9f-a783-0d3459cb11ee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:15.102660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5c0a8-fabe-4b9f-a783-0d3459cb11ee admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:15.116387 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-62d5c0a8-fabe-4b9f-a783-0d3459cb11ee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:15.118240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 250/502] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:15.124153 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba1f86-dab4-4fb8-8fd0-7b4c556a2e5a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:15.135085 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba1f86-dab4-4fb8-8fd0-7b4c556a2e5a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:15.141293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500fff1-a529-4fd4-b2ff-fcbc629ecc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:15.142238 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500fff1-a529-4fd4-b2ff-fcbc629ecc7b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:15.142711 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500fff1-a529-4fd4-b2ff-fcbc629ecc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:15.143143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500fff1-a529-4fd4-b2ff-fcbc629ecc7b admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:15.144081 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500fff1-a529-4fd4-b2ff-fcbc629ecc7b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:15.144582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500fff1-a529-4fd4-b2ff-fcbc629ecc7b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:15.147273 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500fff1-a529-4fd4-b2ff-fcbc629ecc7b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:15.167584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 253/503] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:15.173700 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5c0a8-fabe-4b9f-a783-0d3459cb11ee admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:15.190268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5c0a8-fabe-4b9f-a783-0d3459cb11ee admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:15.195801 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695627bb-ac97-4a4a-ab4a-b22b4175b722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:15.196604 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695627bb-ac97-4a4a-ab4a-b22b4175b722 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:15.197058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695627bb-ac97-4a4a-ab4a-b22b4175b722 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:15.197514 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695627bb-ac97-4a4a-ab4a-b22b4175b722 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:15.198520 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695627bb-ac97-4a4a-ab4a-b22b4175b722 admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=f37041a9727e4ab6a5c52b00327e7a19) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:15.198970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695627bb-ac97-4a4a-ab4a-b22b4175b722 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:15.201116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695627bb-ac97-4a4a-ab4a-b22b4175b722 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:15.211043 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 251/504] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:15 2021] GET /identity/v3/role_assignments?user.id=f37041a9727e4ab6a5c52b00327e7a19&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:16.064649 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1168bc-83a4-4575-bd24-b13c3493e0fa None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.065220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1168bc-83a4-4575-bd24-b13c3493e0fa None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.065220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1168bc-83a4-4575-bd24-b13c3493e0fa None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.067822 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 254/505] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:16.073928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb733db4-c86c-4417-96af-01e28128eea7 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.074376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb733db4-c86c-4417-96af-01e28128eea7 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.074479 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb733db4-c86c-4417-96af-01e28128eea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.099090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-fb733db4-c86c-4417-96af-01e28128eea7 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:16.100349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-fb733db4-c86c-4417-96af-01e28128eea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:16.108468 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 252/506] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:16.145731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1168bc-83a4-4575-bd24-b13c3493e0fa None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.162182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1168bc-83a4-4575-bd24-b13c3493e0fa None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.170446 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f06fe1-43ea-4b49-962b-b3369a0b87cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.171236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f06fe1-43ea-4b49-962b-b3369a0b87cc admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.171509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f06fe1-43ea-4b49-962b-b3369a0b87cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.171777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f06fe1-43ea-4b49-962b-b3369a0b87cc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.186740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f06fe1-43ea-4b49-962b-b3369a0b87cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:16.194207 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-f2f06fe1-43ea-4b49-962b-b3369a0b87cc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:16.195684 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 255/507] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:16.202135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb733db4-c86c-4417-96af-01e28128eea7 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.211706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb733db4-c86c-4417-96af-01e28128eea7 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.216121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2dcf5-bb6e-4779-ae29-6b0e9440935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.216778 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2dcf5-bb6e-4779-ae29-6b0e9440935e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.217057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2dcf5-bb6e-4779-ae29-6b0e9440935e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.217324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2dcf5-bb6e-4779-ae29-6b0e9440935e admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.218089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2dcf5-bb6e-4779-ae29-6b0e9440935e admin admin] RBAC: Adding query filter params (name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:16.218390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2dcf5-bb6e-4779-ae29-6b0e9440935e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.219972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2dcf5-bb6e-4779-ae29-6b0e9440935e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.233178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 253/508] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:16.239523 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f06fe1-43ea-4b49-962b-b3369a0b87cc admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.250245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f06fe1-43ea-4b49-962b-b3369a0b87cc admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.262531 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82da28e-3537-4d0c-9b31-2544c514396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.263330 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82da28e-3537-4d0c-9b31-2544c514396a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.263604 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82da28e-3537-4d0c-9b31-2544c514396a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.263873 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82da28e-3537-4d0c-9b31-2544c514396a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.279237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82da28e-3537-4d0c-9b31-2544c514396a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.281138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82da28e-3537-4d0c-9b31-2544c514396a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.304902 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-c82da28e-3537-4d0c-9b31-2544c514396a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:16.306371 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 256/509] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:16.312270 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2dcf5-bb6e-4779-ae29-6b0e9440935e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.326895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2dcf5-bb6e-4779-ae29-6b0e9440935e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.335347 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453976d-9f1b-4fe8-91ba-ad503ebf23fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.336011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453976d-9f1b-4fe8-91ba-ad503ebf23fd admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.336288 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453976d-9f1b-4fe8-91ba-ad503ebf23fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.336560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453976d-9f1b-4fe8-91ba-ad503ebf23fd admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.337270 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453976d-9f1b-4fe8-91ba-ad503ebf23fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:16.337570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453976d-9f1b-4fe8-91ba-ad503ebf23fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.339178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453976d-9f1b-4fe8-91ba-ad503ebf23fd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.356935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 254/510] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:16.362946 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82da28e-3537-4d0c-9b31-2544c514396a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.378816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82da28e-3537-4d0c-9b31-2544c514396a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.388370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fc6f7-78a9-40b8-984f-b9cc6afd56a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.389162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fc6f7-78a9-40b8-984f-b9cc6afd56a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.389438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fc6f7-78a9-40b8-984f-b9cc6afd56a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.389711 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fc6f7-78a9-40b8-984f-b9cc6afd56a9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.403079 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fc6f7-78a9-40b8-984f-b9cc6afd56a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.405112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fc6f7-78a9-40b8-984f-b9cc6afd56a9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.425552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-8d8fc6f7-78a9-40b8-984f-b9cc6afd56a9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 14:18:16.428329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 257/511] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:16.434384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453976d-9f1b-4fe8-91ba-ad503ebf23fd admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.445074 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453976d-9f1b-4fe8-91ba-ad503ebf23fd admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.449727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7daabb-fa56-49b0-b5f6-e4aaaf264c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.450431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7daabb-fa56-49b0-b5f6-e4aaaf264c0d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.450707 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7daabb-fa56-49b0-b5f6-e4aaaf264c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.450974 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7daabb-fa56-49b0-b5f6-e4aaaf264c0d admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.451816 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7daabb-fa56-49b0-b5f6-e4aaaf264c0d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:16.452115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7daabb-fa56-49b0-b5f6-e4aaaf264c0d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.454024 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7daabb-fa56-49b0-b5f6-e4aaaf264c0d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.474187 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 255/512] 10.222.0.16 () {56 vars in 1155 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:16.480278 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fc6f7-78a9-40b8-984f-b9cc6afd56a9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.491127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fc6f7-78a9-40b8-984f-b9cc6afd56a9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.495708 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65488985-19fd-4e26-9fda-c1ec13b417f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.496429 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65488985-19fd-4e26-9fda-c1ec13b417f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.496718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65488985-19fd-4e26-9fda-c1ec13b417f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.496989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65488985-19fd-4e26-9fda-c1ec13b417f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.510019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65488985-19fd-4e26-9fda-c1ec13b417f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.511828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65488985-19fd-4e26-9fda-c1ec13b417f8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.527701 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 258/513] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:16.533978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7daabb-fa56-49b0-b5f6-e4aaaf264c0d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.546376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7daabb-fa56-49b0-b5f6-e4aaaf264c0d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.551889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4cddc-bba1-4a5f-9ddc-587b1b4342ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.552721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4cddc-bba1-4a5f-9ddc-587b1b4342ff admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.553049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4cddc-bba1-4a5f-9ddc-587b1b4342ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.553323 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4cddc-bba1-4a5f-9ddc-587b1b4342ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.567245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4cddc-bba1-4a5f-9ddc-587b1b4342ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.569162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4cddc-bba1-4a5f-9ddc-587b1b4342ff admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.589396 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-fdc4cddc-bba1-4a5f-9ddc-587b1b4342ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:16.590916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 256/514] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:16.596726 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65488985-19fd-4e26-9fda-c1ec13b417f8 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.610784 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65488985-19fd-4e26-9fda-c1ec13b417f8 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.619754 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dc143-82aa-496c-b55d-8cfa9b5779ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.620471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dc143-82aa-496c-b55d-8cfa9b5779ae admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.620750 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dc143-82aa-496c-b55d-8cfa9b5779ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.621023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dc143-82aa-496c-b55d-8cfa9b5779ae admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.621786 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dc143-82aa-496c-b55d-8cfa9b5779ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:16.622120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dc143-82aa-496c-b55d-8cfa9b5779ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.623751 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dc143-82aa-496c-b55d-8cfa9b5779ae admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.647320 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 259/515] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:16.653174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4cddc-bba1-4a5f-9ddc-587b1b4342ff admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.657695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb796e-3ef9-470f-b68a-7796629177c4 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.658009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb796e-3ef9-470f-b68a-7796629177c4 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.658283 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb796e-3ef9-470f-b68a-7796629177c4 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.660781 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 260/516] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:16.666697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4cddc-bba1-4a5f-9ddc-587b1b4342ff admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.666987 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba036e47-02be-4a41-a0da-a732d180a7aa None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.667169 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba036e47-02be-4a41-a0da-a732d180a7aa None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.667422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba036e47-02be-4a41-a0da-a732d180a7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.683945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba80eb-a21b-4b61-bb32-19dab506d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.684746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba80eb-a21b-4b61-bb32-19dab506d609 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.685028 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba80eb-a21b-4b61-bb32-19dab506d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.685298 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba80eb-a21b-4b61-bb32-19dab506d609 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.687199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-ba036e47-02be-4a41-a0da-a732d180a7aa None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:16.688458 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ba036e47-02be-4a41-a0da-a732d180a7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:16.696883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 261/517] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:16.697356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba80eb-a21b-4b61-bb32-19dab506d609 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.699523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba80eb-a21b-4b61-bb32-19dab506d609 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.721294 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba036e47-02be-4a41-a0da-a732d180a7aa None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.728036 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-92ba80eb-a21b-4b61-bb32-19dab506d609 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:16.729227 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 257/518] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:16.736652 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba036e47-02be-4a41-a0da-a732d180a7aa None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.739982 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba80eb-a21b-4b61-bb32-19dab506d609 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.742752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c47ea0-f99a-445a-a3ad-c480576ead90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.743780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c47ea0-f99a-445a-a3ad-c480576ead90 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.744200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c47ea0-f99a-445a-a3ad-c480576ead90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.744609 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c47ea0-f99a-445a-a3ad-c480576ead90 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.756532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c47ea0-f99a-445a-a3ad-c480576ead90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:16.758996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba80eb-a21b-4b61-bb32-19dab506d609 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.764429 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-53c47ea0-f99a-445a-a3ad-c480576ead90 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:16.766074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 262/519] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:16.771978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3d48d-a9b5-4f1d-9fb5-789acbca800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.772651 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3d48d-a9b5-4f1d-9fb5-789acbca800b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.772930 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3d48d-a9b5-4f1d-9fb5-789acbca800b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.773200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3d48d-a9b5-4f1d-9fb5-789acbca800b admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.773499 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c47ea0-f99a-445a-a3ad-c480576ead90 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.774032 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3d48d-a9b5-4f1d-9fb5-789acbca800b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:16.774317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3d48d-a9b5-4f1d-9fb5-789acbca800b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.776276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3d48d-a9b5-4f1d-9fb5-789acbca800b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.783707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c47ea0-f99a-445a-a3ad-c480576ead90 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.789151 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158510b6-9ad4-4752-8d54-ffaaed625d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.790047 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158510b6-9ad4-4752-8d54-ffaaed625d9c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.790537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158510b6-9ad4-4752-8d54-ffaaed625d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.790987 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158510b6-9ad4-4752-8d54-ffaaed625d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.791858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158510b6-9ad4-4752-8d54-ffaaed625d9c admin admin] RBAC: Adding query filter params (name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:16.792338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158510b6-9ad4-4752-8d54-ffaaed625d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.794169 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158510b6-9ad4-4752-8d54-ffaaed625d9c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.802555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 258/520] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:16.813891 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 263/521] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:16.814074 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3d48d-a9b5-4f1d-9fb5-789acbca800b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.815826 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73af22-ecfa-4a2a-a104-3dc37726cf54 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.816118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73af22-ecfa-4a2a-a104-3dc37726cf54 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.816393 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73af22-ecfa-4a2a-a104-3dc37726cf54 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.819372 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 264/522] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:16.820315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73af22-ecfa-4a2a-a104-3dc37726cf54 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.824161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3d48d-a9b5-4f1d-9fb5-789acbca800b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.836112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6cfc9-bd3b-477c-9292-8b671ddfa883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.836842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6cfc9-bd3b-477c-9292-8b671ddfa883 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.837120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6cfc9-bd3b-477c-9292-8b671ddfa883 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.837393 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6cfc9-bd3b-477c-9292-8b671ddfa883 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.838490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6cfc9-bd3b-477c-9292-8b671ddfa883 admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=d8c0afa8f09f4923b9c8ab2696156129) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:16.838900 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6cfc9-bd3b-477c-9292-8b671ddfa883 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.839573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73af22-ecfa-4a2a-a104-3dc37726cf54 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.841164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6cfc9-bd3b-477c-9292-8b671ddfa883 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.844311 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998b21-dc0f-4f63-9ac8-cacef1fd3f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.845301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998b21-dc0f-4f63-9ac8-cacef1fd3f98 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.845728 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998b21-dc0f-4f63-9ac8-cacef1fd3f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.846156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998b21-dc0f-4f63-9ac8-cacef1fd3f98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.849213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 259/523] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/role_assignments?user.id=d8c0afa8f09f4923b9c8ab2696156129&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:16.850845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9768b-2b07-4f84-86e2-4330bc49a8f5 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.851132 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9768b-2b07-4f84-86e2-4330bc49a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.851408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9768b-2b07-4f84-86e2-4330bc49a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.859388 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998b21-dc0f-4f63-9ac8-cacef1fd3f98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.861517 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998b21-dc0f-4f63-9ac8-cacef1fd3f98 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.873954 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-55a9768b-2b07-4f84-86e2-4330bc49a8f5 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:16.875189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-55a9768b-2b07-4f84-86e2-4330bc49a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:16.882065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-7f998b21-dc0f-4f63-9ac8-cacef1fd3f98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:16.883349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 260/524] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:16.884097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 265/525] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:16.891176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9768b-2b07-4f84-86e2-4330bc49a8f5 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.907635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9768b-2b07-4f84-86e2-4330bc49a8f5 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.912811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc0f35-aa3b-42b0-a7e9-6932f85d3078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.913499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc0f35-aa3b-42b0-a7e9-6932f85d3078 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.913779 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc0f35-aa3b-42b0-a7e9-6932f85d3078 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.914104 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc0f35-aa3b-42b0-a7e9-6932f85d3078 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.914834 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc0f35-aa3b-42b0-a7e9-6932f85d3078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:16.915136 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc0f35-aa3b-42b0-a7e9-6932f85d3078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.916771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc0f35-aa3b-42b0-a7e9-6932f85d3078 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:16.935090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 261/526] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:16.941159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998b21-dc0f-4f63-9ac8-cacef1fd3f98 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.946443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc0f35-aa3b-42b0-a7e9-6932f85d3078 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.957180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc0f35-aa3b-42b0-a7e9-6932f85d3078 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.960811 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998b21-dc0f-4f63-9ac8-cacef1fd3f98 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:16.962068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d2150-42e7-4399-9538-d8b114613e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.962895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d2150-42e7-4399-9538-d8b114613e4e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.963175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d2150-42e7-4399-9538-d8b114613e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.963494 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d2150-42e7-4399-9538-d8b114613e4e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.971421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e770f-59aa-47c1-aec2-a82852f3719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:16.972411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e770f-59aa-47c1-aec2-a82852f3719f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:16.973204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e770f-59aa-47c1-aec2-a82852f3719f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:16.973670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e770f-59aa-47c1-aec2-a82852f3719f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:16.976442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d2150-42e7-4399-9538-d8b114613e4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:16.984502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-eb8d2150-42e7-4399-9538-d8b114613e4e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:16.986029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 262/527] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:16.995530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e770f-59aa-47c1-aec2-a82852f3719f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:16.995769 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d2150-42e7-4399-9538-d8b114613e4e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:16.996013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e770f-59aa-47c1-aec2-a82852f3719f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.004979 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d2150-42e7-4399-9538-d8b114613e4e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.010172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2288eb-d465-4d86-a222-e5cfaaf83653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.010838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2288eb-d465-4d86-a222-e5cfaaf83653 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.011116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2288eb-d465-4d86-a222-e5cfaaf83653 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.011393 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2288eb-d465-4d86-a222-e5cfaaf83653 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.012140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2288eb-d465-4d86-a222-e5cfaaf83653 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.012442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2288eb-d465-4d86-a222-e5cfaaf83653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.014093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2288eb-d465-4d86-a222-e5cfaaf83653 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.020390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-c11e770f-59aa-47c1-aec2-a82852f3719f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 14:18:17.021884 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 266/528] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/users/cinder => generated 84 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:17.025344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 263/529] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:17.032963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e770f-59aa-47c1-aec2-a82852f3719f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.033242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2288eb-d465-4d86-a222-e5cfaaf83653 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.046430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2288eb-d465-4d86-a222-e5cfaaf83653 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.049679 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e770f-59aa-47c1-aec2-a82852f3719f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.051915 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade54ec-5294-47be-89f5-a415f962a504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.052723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade54ec-5294-47be-89f5-a415f962a504 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.053005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade54ec-5294-47be-89f5-a415f962a504 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.053275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade54ec-5294-47be-89f5-a415f962a504 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.059113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f1127-021b-4213-9bce-8b011abbaf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.059847 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f1127-021b-4213-9bce-8b011abbaf1d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.060127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f1127-021b-4213-9bce-8b011abbaf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.060397 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f1127-021b-4213-9bce-8b011abbaf1d admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.061287 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f1127-021b-4213-9bce-8b011abbaf1d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.061693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f1127-021b-4213-9bce-8b011abbaf1d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.063673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f1127-021b-4213-9bce-8b011abbaf1d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.064755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade54ec-5294-47be-89f5-a415f962a504 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.067434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade54ec-5294-47be-89f5-a415f962a504 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.087165 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-aade54ec-5294-47be-89f5-a415f962a504 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:17.089470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 264/530] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:17.096137 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade54ec-5294-47be-89f5-a415f962a504 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.100246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 267/531] 10.222.0.16 () {56 vars in 1159 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:17.106755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f1127-021b-4213-9bce-8b011abbaf1d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.107068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade54ec-5294-47be-89f5-a415f962a504 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.111460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6647a1-80fb-49f0-9700-f31f48df9a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.112146 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6647a1-80fb-49f0-9700-f31f48df9a1f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.112423 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6647a1-80fb-49f0-9700-f31f48df9a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.112697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6647a1-80fb-49f0-9700-f31f48df9a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.114012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6647a1-80fb-49f0-9700-f31f48df9a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.114510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6647a1-80fb-49f0-9700-f31f48df9a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.116526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6647a1-80fb-49f0-9700-f31f48df9a1f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.130534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 265/532] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:17.132487 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f1127-021b-4213-9bce-8b011abbaf1d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.136973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6647a1-80fb-49f0-9700-f31f48df9a1f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.146614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e3cdc-4e9f-4f77-86eb-d21abd11c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.147341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e3cdc-4e9f-4f77-86eb-d21abd11c1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.147536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6647a1-80fb-49f0-9700-f31f48df9a1f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.147697 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e3cdc-4e9f-4f77-86eb-d21abd11c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.147894 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e3cdc-4e9f-4f77-86eb-d21abd11c1f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.152000 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578490e-94f7-46b8-a682-a03348a9e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.152867 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578490e-94f7-46b8-a682-a03348a9e8fc admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.153153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578490e-94f7-46b8-a682-a03348a9e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.153428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578490e-94f7-46b8-a682-a03348a9e8fc admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.158131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e3cdc-4e9f-4f77-86eb-d21abd11c1f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.159938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e3cdc-4e9f-4f77-86eb-d21abd11c1f0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.162788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578490e-94f7-46b8-a682-a03348a9e8fc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.166293 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578490e-94f7-46b8-a682-a03348a9e8fc admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.179121 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 268/533] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:18:17.183301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-3578490e-94f7-46b8-a682-a03348a9e8fc admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 14:18:17.184493 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 266/534] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/users/glance => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:17.189630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e3cdc-4e9f-4f77-86eb-d21abd11c1f0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.190488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578490e-94f7-46b8-a682-a03348a9e8fc admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.204564 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e3cdc-4e9f-4f77-86eb-d21abd11c1f0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.204891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578490e-94f7-46b8-a682-a03348a9e8fc admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.209077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc5a03-26d4-4715-abac-4e52aca0e1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.209397 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9900bbf-b21b-47e6-a3ff-508c5aa66cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.209957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc5a03-26d4-4715-abac-4e52aca0e1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.210312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc5a03-26d4-4715-abac-4e52aca0e1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.210693 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc5a03-26d4-4715-abac-4e52aca0e1d8 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.210954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9900bbf-b21b-47e6-a3ff-508c5aa66cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.211408 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9900bbf-b21b-47e6-a3ff-508c5aa66cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.211714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc5a03-26d4-4715-abac-4e52aca0e1d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.212025 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9900bbf-b21b-47e6-a3ff-508c5aa66cf2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.212135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc5a03-26d4-4715-abac-4e52aca0e1d8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.214382 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc5a03-26d4-4715-abac-4e52aca0e1d8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.225229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9900bbf-b21b-47e6-a3ff-508c5aa66cf2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.228163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9900bbf-b21b-47e6-a3ff-508c5aa66cf2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.235111 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 267/535] 10.222.0.16 () {56 vars in 1159 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:17.241453 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc5a03-26d4-4715-abac-4e52aca0e1d8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.250598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-a9900bbf-b21b-47e6-a3ff-508c5aa66cf2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:17.252218 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 269/536] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:17.259065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9900bbf-b21b-47e6-a3ff-508c5aa66cf2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.266275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc5a03-26d4-4715-abac-4e52aca0e1d8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.270574 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9900bbf-b21b-47e6-a3ff-508c5aa66cf2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.271775 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374e53-c710-4941-b2a6-4b49dd8e7ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.272513 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374e53-c710-4941-b2a6-4b49dd8e7ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.272844 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374e53-c710-4941-b2a6-4b49dd8e7ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.273189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374e53-c710-4941-b2a6-4b49dd8e7ee4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.277752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14836ff-e8e9-487c-87c4-472b8824d076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.278692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14836ff-e8e9-487c-87c4-472b8824d076 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.279178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14836ff-e8e9-487c-87c4-472b8824d076 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.279670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14836ff-e8e9-487c-87c4-472b8824d076 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.280604 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14836ff-e8e9-487c-87c4-472b8824d076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.281162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14836ff-e8e9-487c-87c4-472b8824d076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.283056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14836ff-e8e9-487c-87c4-472b8824d076 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.283955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac374e53-c710-4941-b2a6-4b49dd8e7ee4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.286631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac374e53-c710-4941-b2a6-4b49dd8e7ee4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.295975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 270/537] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:17.297041 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 268/538] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:18:17.308090 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14836ff-e8e9-487c-87c4-472b8824d076 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.308322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374e53-c710-4941-b2a6-4b49dd8e7ee4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.318565 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14836ff-e8e9-487c-87c4-472b8824d076 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.318948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374e53-c710-4941-b2a6-4b49dd8e7ee4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.326690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05774f-92ad-4a17-ae73-ac76b7c778b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.327471 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05774f-92ad-4a17-ae73-ac76b7c778b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.327755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05774f-92ad-4a17-ae73-ac76b7c778b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.328028 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05774f-92ad-4a17-ae73-ac76b7c778b7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.329069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496eadc-4bd7-48a0-8d95-240c41aac326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.329844 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496eadc-4bd7-48a0-8d95-240c41aac326 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.330151 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496eadc-4bd7-48a0-8d95-240c41aac326 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.330419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496eadc-4bd7-48a0-8d95-240c41aac326 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.339511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05774f-92ad-4a17-ae73-ac76b7c778b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.341754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05774f-92ad-4a17-ae73-ac76b7c778b7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.343485 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496eadc-4bd7-48a0-8d95-240c41aac326 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.345344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496eadc-4bd7-48a0-8d95-240c41aac326 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.356730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-6e05774f-92ad-4a17-ae73-ac76b7c778b7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:17.358583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 269/539] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:17.367233 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-b496eadc-4bd7-48a0-8d95-240c41aac326 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:17.368299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05774f-92ad-4a17-ae73-ac76b7c778b7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.370073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 271/540] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:17.378391 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496eadc-4bd7-48a0-8d95-240c41aac326 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.383147 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05774f-92ad-4a17-ae73-ac76b7c778b7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.388973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496eadc-4bd7-48a0-8d95-240c41aac326 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.389209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9abfc-a808-4bd6-8dc6-172c58a070ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.391051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9abfc-a808-4bd6-8dc6-172c58a070ba admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.391578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9abfc-a808-4bd6-8dc6-172c58a070ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.391986 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9abfc-a808-4bd6-8dc6-172c58a070ba admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.392994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9abfc-a808-4bd6-8dc6-172c58a070ba admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.393457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9abfc-a808-4bd6-8dc6-172c58a070ba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.396229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9abfc-a808-4bd6-8dc6-172c58a070ba admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.396346 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3ed5-5e67-4059-9321-95122cb2fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.397171 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3ed5-5e67-4059-9321-95122cb2fabc admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.397540 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3ed5-5e67-4059-9321-95122cb2fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.397965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3ed5-5e67-4059-9321-95122cb2fabc admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.398863 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3ed5-5e67-4059-9321-95122cb2fabc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.399349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3ed5-5e67-4059-9321-95122cb2fabc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.401170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3ed5-5e67-4059-9321-95122cb2fabc admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.411728 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 270/541] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:17.418811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9abfc-a808-4bd6-8dc6-172c58a070ba admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.421697 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 272/542] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:17.428234 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3ed5-5e67-4059-9321-95122cb2fabc admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.430073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9abfc-a808-4bd6-8dc6-172c58a070ba admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.434828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b03bf-8b26-4b82-9f5a-b0c11740311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.435496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b03bf-8b26-4b82-9f5a-b0c11740311b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.435776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b03bf-8b26-4b82-9f5a-b0c11740311b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.436049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b03bf-8b26-4b82-9f5a-b0c11740311b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.437204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b03bf-8b26-4b82-9f5a-b0c11740311b admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=9ca81ff9c3114e8c9379418956063bb2) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.437204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b03bf-8b26-4b82-9f5a-b0c11740311b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.440097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b03bf-8b26-4b82-9f5a-b0c11740311b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.442878 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3ed5-5e67-4059-9321-95122cb2fabc admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.447802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 271/543] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/role_assignments?user.id=9ca81ff9c3114e8c9379418956063bb2&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:17.450814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c10c01-4d3d-4993-8a5a-1e2b45a5df53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.452074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c10c01-4d3d-4993-8a5a-1e2b45a5df53 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.452568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c10c01-4d3d-4993-8a5a-1e2b45a5df53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.453037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c10c01-4d3d-4993-8a5a-1e2b45a5df53 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.462931 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c10c01-4d3d-4993-8a5a-1e2b45a5df53 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.465384 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c10c01-4d3d-4993-8a5a-1e2b45a5df53 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.480636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-30c10c01-4d3d-4993-8a5a-1e2b45a5df53 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:17.482719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 273/544] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:17.489430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b03bf-8b26-4b82-9f5a-b0c11740311b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.503749 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b03bf-8b26-4b82-9f5a-b0c11740311b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.520674 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a68c-83a4-4531-a5ad-0d8649d4a582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.521353 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a68c-83a4-4531-a5ad-0d8649d4a582 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.521634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a68c-83a4-4531-a5ad-0d8649d4a582 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.522003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a68c-83a4-4531-a5ad-0d8649d4a582 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.522796 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416a68c-83a4-4531-a5ad-0d8649d4a582 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.523105 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416a68c-83a4-4531-a5ad-0d8649d4a582 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.524946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416a68c-83a4-4531-a5ad-0d8649d4a582 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.539174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3757b-6f0b-446b-975b-07202647fb37 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.539783 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3757b-6f0b-446b-975b-07202647fb37 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.540283 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3757b-6f0b-446b-975b-07202647fb37 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.542540 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 274/545] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:17.544650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 272/546] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:17.549687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb8666-6932-4738-893d-71a6b06c54d6 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.550029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb8666-6932-4738-893d-71a6b06c54d6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.550278 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb8666-6932-4738-893d-71a6b06c54d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.556018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a68c-83a4-4531-a5ad-0d8649d4a582 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.566162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a68c-83a4-4531-a5ad-0d8649d4a582 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.572409 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a59e0-4869-414f-b41d-7dfa9fe6d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.573112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a59e0-4869-414f-b41d-7dfa9fe6d32c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.573393 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a59e0-4869-414f-b41d-7dfa9fe6d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.573664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a59e0-4869-414f-b41d-7dfa9fe6d32c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.574534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a59e0-4869-414f-b41d-7dfa9fe6d32c admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=db83070471e34df695b571cdab440b1b) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.574845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a59e0-4869-414f-b41d-7dfa9fe6d32c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.577181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a59e0-4869-414f-b41d-7dfa9fe6d32c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.584229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 273/547] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/role_assignments?user.id=db83070471e34df695b571cdab440b1b&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:17.588846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-dcdb8666-6932-4738-893d-71a6b06c54d6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:17.590097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-dcdb8666-6932-4738-893d-71a6b06c54d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:17.616908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 275/548] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:17.659551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a59e0-4869-414f-b41d-7dfa9fe6d32c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.670829 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a59e0-4869-414f-b41d-7dfa9fe6d32c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.679138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599680ba-f8c9-410d-8e4d-92f498eddcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.680120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599680ba-f8c9-410d-8e4d-92f498eddcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.680509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599680ba-f8c9-410d-8e4d-92f498eddcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.680887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599680ba-f8c9-410d-8e4d-92f498eddcb5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.703984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599680ba-f8c9-410d-8e4d-92f498eddcb5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:17.711248 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-599680ba-f8c9-410d-8e4d-92f498eddcb5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:17.712655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 274/549] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:17.719477 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb8666-6932-4738-893d-71a6b06c54d6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.735307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb8666-6932-4738-893d-71a6b06c54d6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.743296 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641c1ee-1307-4518-a112-07451c3422f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.743911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641c1ee-1307-4518-a112-07451c3422f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.744193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641c1ee-1307-4518-a112-07451c3422f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.744466 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641c1ee-1307-4518-a112-07451c3422f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.745222 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641c1ee-1307-4518-a112-07451c3422f1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.745528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641c1ee-1307-4518-a112-07451c3422f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.747181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641c1ee-1307-4518-a112-07451c3422f1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.762166 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 276/550] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:17.768303 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599680ba-f8c9-410d-8e4d-92f498eddcb5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.778879 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599680ba-f8c9-410d-8e4d-92f498eddcb5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.789400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317de36e-52b4-4a80-b483-0254a2df7525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.790305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317de36e-52b4-4a80-b483-0254a2df7525 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.790586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317de36e-52b4-4a80-b483-0254a2df7525 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.790859 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317de36e-52b4-4a80-b483-0254a2df7525 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.804419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317de36e-52b4-4a80-b483-0254a2df7525 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.806354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317de36e-52b4-4a80-b483-0254a2df7525 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.825337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-317de36e-52b4-4a80-b483-0254a2df7525 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:17.826978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 275/551] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:17.834587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641c1ee-1307-4518-a112-07451c3422f1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.851623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641c1ee-1307-4518-a112-07451c3422f1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.856797 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a362d9-22b0-46c8-9897-678d5743a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.857457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a362d9-22b0-46c8-9897-678d5743a2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.857736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a362d9-22b0-46c8-9897-678d5743a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.858036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a362d9-22b0-46c8-9897-678d5743a2a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.858862 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a362d9-22b0-46c8-9897-678d5743a2a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.859166 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a362d9-22b0-46c8-9897-678d5743a2a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.860750 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a362d9-22b0-46c8-9897-678d5743a2a3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.874300 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 277/552] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:17.880779 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317de36e-52b4-4a80-b483-0254a2df7525 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.890896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317de36e-52b4-4a80-b483-0254a2df7525 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.895377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc3f27-954a-42f5-a61e-91b72cbdfc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.896166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc3f27-954a-42f5-a61e-91b72cbdfc8f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.896449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc3f27-954a-42f5-a61e-91b72cbdfc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.896720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc3f27-954a-42f5-a61e-91b72cbdfc8f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.904971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc3f27-954a-42f5-a61e-91b72cbdfc8f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.907069 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc3f27-954a-42f5-a61e-91b72cbdfc8f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.908950 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04c3db-aca9-4da2-b6e1-628d088a1f01 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.909241 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04c3db-aca9-4da2-b6e1-628d088a1f01 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.909516 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04c3db-aca9-4da2-b6e1-628d088a1f01 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.911715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 278/553] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:17.917695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fd734-98de-4161-9bf7-3bcc622f6676 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.918022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fd734-98de-4161-9bf7-3bcc622f6676 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.918301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fd734-98de-4161-9bf7-3bcc622f6676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.921384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-cdbc3f27-954a-42f5-a61e-91b72cbdfc8f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 14:18:17.922864 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 276/554] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/users/neutron => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:17.929471 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc3f27-954a-42f5-a61e-91b72cbdfc8f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.942222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc3f27-954a-42f5-a61e-91b72cbdfc8f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.944843 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0e7fd734-98de-4161-9bf7-3bcc622f6676 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:17.946125 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0e7fd734-98de-4161-9bf7-3bcc622f6676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:17.947069 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde8720-d318-44fe-a6f8-e00683f9834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.947741 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde8720-d318-44fe-a6f8-e00683f9834a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.948027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde8720-d318-44fe-a6f8-e00683f9834a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.948302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde8720-d318-44fe-a6f8-e00683f9834a admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.949134 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde8720-d318-44fe-a6f8-e00683f9834a admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:17.949435 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde8720-d318-44fe-a6f8-e00683f9834a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:17.952917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde8720-d318-44fe-a6f8-e00683f9834a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:17.959160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 279/555] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:17.973812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 277/556] 10.222.0.16 () {56 vars in 1161 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:17.979846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fd734-98de-4161-9bf7-3bcc622f6676 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.987389 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde8720-d318-44fe-a6f8-e00683f9834a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:17.991046 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fd734-98de-4161-9bf7-3bcc622f6676 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:17.996420 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b03eb4-e2d5-4c2a-97fa-cb9ed094ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:17.997278 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b03eb4-e2d5-4c2a-97fa-cb9ed094ef49 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:17.997698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b03eb4-e2d5-4c2a-97fa-cb9ed094ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:17.998170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b03eb4-e2d5-4c2a-97fa-cb9ed094ef49 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:17.999139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde8720-d318-44fe-a6f8-e00683f9834a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.010023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b03eb4-e2d5-4c2a-97fa-cb9ed094ef49 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.011456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650ab03-4d8e-4520-8daf-a82add8aba02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.012258 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650ab03-4d8e-4520-8daf-a82add8aba02 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.012482 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b03eb4-e2d5-4c2a-97fa-cb9ed094ef49 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.012608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650ab03-4d8e-4520-8daf-a82add8aba02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.012792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650ab03-4d8e-4520-8daf-a82add8aba02 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.023516 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 280/557] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:18.031616 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b03eb4-e2d5-4c2a-97fa-cb9ed094ef49 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.034731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650ab03-4d8e-4520-8daf-a82add8aba02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:18.041889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b03eb4-e2d5-4c2a-97fa-cb9ed094ef49 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.042207 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-9650ab03-4d8e-4520-8daf-a82add8aba02 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:18.043811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 278/558] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:18.048857 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa6aaa-6b1a-489b-bfb1-b65cfb3da921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.050089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa6aaa-6b1a-489b-bfb1-b65cfb3da921 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.050383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa6aaa-6b1a-489b-bfb1-b65cfb3da921 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.050658 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa6aaa-6b1a-489b-bfb1-b65cfb3da921 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.052072 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650ab03-4d8e-4520-8daf-a82add8aba02 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.062839 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa6aaa-6b1a-489b-bfb1-b65cfb3da921 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.064330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650ab03-4d8e-4520-8daf-a82add8aba02 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.064783 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa6aaa-6b1a-489b-bfb1-b65cfb3da921 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.072527 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d272f-ea3b-41d4-8316-3e005be96114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.073460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d272f-ea3b-41d4-8316-3e005be96114 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.073975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d272f-ea3b-41d4-8316-3e005be96114 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.074453 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d272f-ea3b-41d4-8316-3e005be96114 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.075386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d272f-ea3b-41d4-8316-3e005be96114 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:18.075861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d272f-ea3b-41d4-8316-3e005be96114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.077607 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d272f-ea3b-41d4-8316-3e005be96114 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.084575 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-bdfa6aaa-6b1a-489b-bfb1-b65cfb3da921 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:18.093950 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 281/559] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:18.094109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 279/560] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:18.096814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa6aaa-6b1a-489b-bfb1-b65cfb3da921 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.097008 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d272f-ea3b-41d4-8316-3e005be96114 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.109949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d272f-ea3b-41d4-8316-3e005be96114 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.113085 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa6aaa-6b1a-489b-bfb1-b65cfb3da921 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.121515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705e88c-7390-4ef6-a450-5d65649a7869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.122223 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce801b4-673c-49e9-9a56-a6dcb47b04f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.123004 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce801b4-673c-49e9-9a56-a6dcb47b04f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.123444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705e88c-7390-4ef6-a450-5d65649a7869 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.123717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705e88c-7390-4ef6-a450-5d65649a7869 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.123985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705e88c-7390-4ef6-a450-5d65649a7869 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.124686 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce801b4-673c-49e9-9a56-a6dcb47b04f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.124955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce801b4-673c-49e9-9a56-a6dcb47b04f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.126162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705e88c-7390-4ef6-a450-5d65649a7869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:18.126475 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705e88c-7390-4ef6-a450-5d65649a7869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.130991 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705e88c-7390-4ef6-a450-5d65649a7869 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.147268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce801b4-673c-49e9-9a56-a6dcb47b04f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.149326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce801b4-673c-49e9-9a56-a6dcb47b04f4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.154227 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 282/561] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:18.160880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705e88c-7390-4ef6-a450-5d65649a7869 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.181521 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705e88c-7390-4ef6-a450-5d65649a7869 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.182556 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-7ce801b4-673c-49e9-9a56-a6dcb47b04f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:18.184958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 280/562] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:18.191286 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce801b4-673c-49e9-9a56-a6dcb47b04f4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.192682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49ef52-75a6-4c09-ba72-d9a168277c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.193536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49ef52-75a6-4c09-ba72-d9a168277c38 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.193814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49ef52-75a6-4c09-ba72-d9a168277c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.194153 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49ef52-75a6-4c09-ba72-d9a168277c38 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.206008 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce801b4-673c-49e9-9a56-a6dcb47b04f4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.208497 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49ef52-75a6-4c09-ba72-d9a168277c38 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.210508 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49ef52-75a6-4c09-ba72-d9a168277c38 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.218815 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0802ca9-31be-4e19-8149-50a57f402682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.219619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0802ca9-31be-4e19-8149-50a57f402682 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.219907 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0802ca9-31be-4e19-8149-50a57f402682 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.220191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0802ca9-31be-4e19-8149-50a57f402682 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.220921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0802ca9-31be-4e19-8149-50a57f402682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:18.221228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0802ca9-31be-4e19-8149-50a57f402682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.223597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0802ca9-31be-4e19-8149-50a57f402682 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.228491 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-aa49ef52-75a6-4c09-ba72-d9a168277c38 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:18.229983 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 283/563] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:18.241209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 281/564] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:18.242183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49ef52-75a6-4c09-ba72-d9a168277c38 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.249929 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0802ca9-31be-4e19-8149-50a57f402682 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.261472 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49ef52-75a6-4c09-ba72-d9a168277c38 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.267468 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0802ca9-31be-4e19-8149-50a57f402682 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.272481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1433d-f255-4cf6-a66b-52f96a33028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.274270 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1433d-f255-4cf6-a66b-52f96a33028d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.274556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1433d-f255-4cf6-a66b-52f96a33028d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.274832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1433d-f255-4cf6-a66b-52f96a33028d admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.276031 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1433d-f255-4cf6-a66b-52f96a33028d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:18.276338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1433d-f255-4cf6-a66b-52f96a33028d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.277655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b9d7b-1a37-447d-9852-fc54864a2a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.278533 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b9d7b-1a37-447d-9852-fc54864a2a3c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.278812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b9d7b-1a37-447d-9852-fc54864a2a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.279659 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b9d7b-1a37-447d-9852-fc54864a2a3c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.280881 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1433d-f255-4cf6-a66b-52f96a33028d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.297201 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b9d7b-1a37-447d-9852-fc54864a2a3c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.300960 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b9d7b-1a37-447d-9852-fc54864a2a3c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.304359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 284/565] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:18.311056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1433d-f255-4cf6-a66b-52f96a33028d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.326570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-a39b9d7b-1a37-447d-9852-fc54864a2a3c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 14:18:18.329475 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1433d-f255-4cf6-a66b-52f96a33028d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.331231 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 282/566] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/users/swift => generated 83 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:18.339288 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917289f-532e-4325-b902-9582ed6650bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.339925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917289f-532e-4325-b902-9582ed6650bb admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.340209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917289f-532e-4325-b902-9582ed6650bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.340546 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917289f-532e-4325-b902-9582ed6650bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.341428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917289f-532e-4325-b902-9582ed6650bb admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=f13a39de23f04cb0a2f5b050d740334a) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:18.341745 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917289f-532e-4325-b902-9582ed6650bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.343657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917289f-532e-4325-b902-9582ed6650bb admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.349462 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b9d7b-1a37-447d-9852-fc54864a2a3c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.359428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b9d7b-1a37-447d-9852-fc54864a2a3c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.363690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 285/567] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/role_assignments?user.id=f13a39de23f04cb0a2f5b050d740334a&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:18.373518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3542-0b00-4e54-838d-4332314ec3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.374375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3542-0b00-4e54-838d-4332314ec3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.374776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3542-0b00-4e54-838d-4332314ec3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.375149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3542-0b00-4e54-838d-4332314ec3f0 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.376068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d3542-0b00-4e54-838d-4332314ec3f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:18.376475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d3542-0b00-4e54-838d-4332314ec3f0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.378526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d3542-0b00-4e54-838d-4332314ec3f0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.404191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 283/568] 10.222.0.16 () {56 vars in 1157 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:18.410080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917289f-532e-4325-b902-9582ed6650bb admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.421562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917289f-532e-4325-b902-9582ed6650bb admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.427886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f02db-9980-4cb0-b5fe-225398546c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.428790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f02db-9980-4cb0-b5fe-225398546c5f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.429139 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f02db-9980-4cb0-b5fe-225398546c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.429481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f02db-9980-4cb0-b5fe-225398546c5f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.449328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f02db-9980-4cb0-b5fe-225398546c5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.451383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f02db-9980-4cb0-b5fe-225398546c5f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.472766 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-9e0f02db-9980-4cb0-b5fe-225398546c5f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:18.474578 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 286/569] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:18.481026 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3542-0b00-4e54-838d-4332314ec3f0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.491678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3542-0b00-4e54-838d-4332314ec3f0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.501351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f58bd5-23ca-4e4e-967e-5b74b7529ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.502065 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f58bd5-23ca-4e4e-967e-5b74b7529ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.502345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f58bd5-23ca-4e4e-967e-5b74b7529ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.502663 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f58bd5-23ca-4e4e-967e-5b74b7529ac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.503404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f58bd5-23ca-4e4e-967e-5b74b7529ac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:18.503709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f58bd5-23ca-4e4e-967e-5b74b7529ac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.506046 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f58bd5-23ca-4e4e-967e-5b74b7529ac6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.524883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 284/570] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:18.531460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f02db-9980-4cb0-b5fe-225398546c5f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.542842 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f02db-9980-4cb0-b5fe-225398546c5f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.554375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828b3e3-2485-441c-b3d6-a27d846515e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.555183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828b3e3-2485-441c-b3d6-a27d846515e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.555467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828b3e3-2485-441c-b3d6-a27d846515e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.555741 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828b3e3-2485-441c-b3d6-a27d846515e5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.564712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828b3e3-2485-441c-b3d6-a27d846515e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.565603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828b3e3-2485-441c-b3d6-a27d846515e5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.582343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-b828b3e3-2485-441c-b3d6-a27d846515e5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:18.584301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 287/571] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:18.590523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f58bd5-23ca-4e4e-967e-5b74b7529ac6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.603114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f58bd5-23ca-4e4e-967e-5b74b7529ac6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.607955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84e64-0dba-4cd0-8c0b-899a13138072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.608819 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84e64-0dba-4cd0-8c0b-899a13138072 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.609300 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84e64-0dba-4cd0-8c0b-899a13138072 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.609762 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84e64-0dba-4cd0-8c0b-899a13138072 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.610777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84e64-0dba-4cd0-8c0b-899a13138072 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:18.611297 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84e64-0dba-4cd0-8c0b-899a13138072 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.614005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84e64-0dba-4cd0-8c0b-899a13138072 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.627708 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 285/572] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:18.635347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828b3e3-2485-441c-b3d6-a27d846515e5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:18.650423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828b3e3-2485-441c-b3d6-a27d846515e5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:18.657550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294a676-6d23-4216-ba0e-09b1265d21c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:18.658706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294a676-6d23-4216-ba0e-09b1265d21c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:18.659201 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294a676-6d23-4216-ba0e-09b1265d21c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:18.659645 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294a676-6d23-4216-ba0e-09b1265d21c3 admin admin] PATH_INFO: `/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/f37041a9727e4ab6a5c52b00327e7a19/roles/ac37a5f3e1454b8f929c2419c3e148cb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:18.682204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294a676-6d23-4216-ba0e-09b1265d21c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c728e9160de45afbd4902c27eef45b3, user_id=f37041a9727e4ab6a5c52b00327e7a19, role_id=ac37a5f3e1454b8f929c2419c3e148cb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:18.685335 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294a676-6d23-4216-ba0e-09b1265d21c3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:18.764484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 288/573] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:18:18 2021] PUT /identity/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/f37041a9727e4ab6a5c52b00327e7a19/roles/ac37a5f3e1454b8f929c2419c3e148cb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:18:19.771903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc473e-5497-4dcc-9f42-d140cad7764f None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:19.772410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc473e-5497-4dcc-9f42-d140cad7764f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:19.772484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc473e-5497-4dcc-9f42-d140cad7764f None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:19.774549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 286/574] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:19.780764 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a7ceb-c0bc-455a-b4ff-1b20d8ad9538 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:19.781181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a7ceb-c0bc-455a-b4ff-1b20d8ad9538 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:19.781351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a7ceb-c0bc-455a-b4ff-1b20d8ad9538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:19.806927 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0b7a7ceb-c0bc-455a-b4ff-1b20d8ad9538 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:19.808136 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0b7a7ceb-c0bc-455a-b4ff-1b20d8ad9538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:19.891617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 289/575] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:19.925383 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc473e-5497-4dcc-9f42-d140cad7764f None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:19.943695 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc473e-5497-4dcc-9f42-d140cad7764f None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:19.948242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f605b-b00f-4c72-b5ad-abbe209cb2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:19.949113 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f605b-b00f-4c72-b5ad-abbe209cb2ea admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:19.949392 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f605b-b00f-4c72-b5ad-abbe209cb2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:19.949665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f605b-b00f-4c72-b5ad-abbe209cb2ea admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:19.960886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f605b-b00f-4c72-b5ad-abbe209cb2ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:19.971950 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-719f605b-b00f-4c72-b5ad-abbe209cb2ea admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:18:19.978265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 287/576] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:19.980389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a7ceb-c0bc-455a-b4ff-1b20d8ad9538 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:19.995060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a7ceb-c0bc-455a-b4ff-1b20d8ad9538 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.003954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02ec64-3c12-476a-8ff6-d127cb422698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.004713 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02ec64-3c12-476a-8ff6-d127cb422698 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.004992 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02ec64-3c12-476a-8ff6-d127cb422698 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.005264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02ec64-3c12-476a-8ff6-d127cb422698 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.006044 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02ec64-3c12-476a-8ff6-d127cb422698 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:20.006349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02ec64-3c12-476a-8ff6-d127cb422698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.007926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02ec64-3c12-476a-8ff6-d127cb422698 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.020908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 290/577] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:20.027123 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f605b-b00f-4c72-b5ad-abbe209cb2ea admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.038219 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f605b-b00f-4c72-b5ad-abbe209cb2ea admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.046105 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1d7b0-0f97-4332-b69f-828ff6bba9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.046900 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1d7b0-0f97-4332-b69f-828ff6bba9bd admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.047180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1d7b0-0f97-4332-b69f-828ff6bba9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.047453 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1d7b0-0f97-4332-b69f-828ff6bba9bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.059131 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1d7b0-0f97-4332-b69f-828ff6bba9bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.060992 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1d7b0-0f97-4332-b69f-828ff6bba9bd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.086956 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-b8b1d7b0-0f97-4332-b69f-828ff6bba9bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:20.089160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 288/578] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:20.094197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02ec64-3c12-476a-8ff6-d127cb422698 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.108672 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02ec64-3c12-476a-8ff6-d127cb422698 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.118513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb021e1-15d4-47ed-b953-5d3662d08d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.119184 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb021e1-15d4-47ed-b953-5d3662d08d76 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.119463 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb021e1-15d4-47ed-b953-5d3662d08d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.119734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb021e1-15d4-47ed-b953-5d3662d08d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.120455 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb021e1-15d4-47ed-b953-5d3662d08d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:20.120758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb021e1-15d4-47ed-b953-5d3662d08d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.122360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb021e1-15d4-47ed-b953-5d3662d08d76 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.134881 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 291/579] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:20.141043 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1d7b0-0f97-4332-b69f-828ff6bba9bd admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.151530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1d7b0-0f97-4332-b69f-828ff6bba9bd admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.162510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ca9ab-11f0-486a-88d1-9f040eaca3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.163319 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ca9ab-11f0-486a-88d1-9f040eaca3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.163601 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ca9ab-11f0-486a-88d1-9f040eaca3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.163874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ca9ab-11f0-486a-88d1-9f040eaca3e0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.175193 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ca9ab-11f0-486a-88d1-9f040eaca3e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.177380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ca9ab-11f0-486a-88d1-9f040eaca3e0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.195863 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-472ca9ab-11f0-486a-88d1-9f040eaca3e0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 14:18:20.197484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 289/580] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:20.203830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb021e1-15d4-47ed-b953-5d3662d08d76 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.219201 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb021e1-15d4-47ed-b953-5d3662d08d76 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.230745 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a829891-eec3-49f6-870c-4243094da270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.231440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a829891-eec3-49f6-870c-4243094da270 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.231719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a829891-eec3-49f6-870c-4243094da270 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.231992 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a829891-eec3-49f6-870c-4243094da270 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.232837 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a829891-eec3-49f6-870c-4243094da270 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:20.233139 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a829891-eec3-49f6-870c-4243094da270 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.235047 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a829891-eec3-49f6-870c-4243094da270 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.256494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 292/581] 10.222.0.16 () {56 vars in 1155 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:20.262547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ca9ab-11f0-486a-88d1-9f040eaca3e0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.273189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ca9ab-11f0-486a-88d1-9f040eaca3e0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.282061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af93a4-2497-4e5e-9784-6efac2fe8c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.282651 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af93a4-2497-4e5e-9784-6efac2fe8c6d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.282931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af93a4-2497-4e5e-9784-6efac2fe8c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.283205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af93a4-2497-4e5e-9784-6efac2fe8c6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.292364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af93a4-2497-4e5e-9784-6efac2fe8c6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.294177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af93a4-2497-4e5e-9784-6efac2fe8c6d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.303667 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 290/582] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:20.309420 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a829891-eec3-49f6-870c-4243094da270 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.322758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a829891-eec3-49f6-870c-4243094da270 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.330324 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cbcfc-b8fe-4683-8360-72b76cac538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.331120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cbcfc-b8fe-4683-8360-72b76cac538f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.331401 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cbcfc-b8fe-4683-8360-72b76cac538f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.331602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66000ad-1cb7-4f26-bcd0-56f1ff93718b None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.331704 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cbcfc-b8fe-4683-8360-72b76cac538f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.332492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66000ad-1cb7-4f26-bcd0-56f1ff93718b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.332934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66000ad-1cb7-4f26-bcd0-56f1ff93718b None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.334831 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 291/583] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:20.347668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cbcfc-b8fe-4683-8360-72b76cac538f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.348138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ec9f2-3b1b-4289-9ba3-566c523348b5 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.348426 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ec9f2-3b1b-4289-9ba3-566c523348b5 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.348704 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ec9f2-3b1b-4289-9ba3-566c523348b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.349713 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cbcfc-b8fe-4683-8360-72b76cac538f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.377742 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-ed4cbcfc-b8fe-4683-8360-72b76cac538f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:20.384876 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 293/584] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:20.385967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-e11ec9f2-3b1b-4289-9ba3-566c523348b5 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:20.387166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e11ec9f2-3b1b-4289-9ba3-566c523348b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:20.390593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cbcfc-b8fe-4683-8360-72b76cac538f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.402960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cbcfc-b8fe-4683-8360-72b76cac538f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.406268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 292/585] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:20.420178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037e105-9f11-4e2f-9002-c7e2f8b45bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.420859 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037e105-9f11-4e2f-9002-c7e2f8b45bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.421138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037e105-9f11-4e2f-9002-c7e2f8b45bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.421413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037e105-9f11-4e2f-9002-c7e2f8b45bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.422259 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037e105-9f11-4e2f-9002-c7e2f8b45bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:20.422562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037e105-9f11-4e2f-9002-c7e2f8b45bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.424748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037e105-9f11-4e2f-9002-c7e2f8b45bc9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.437997 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 294/586] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:20.447032 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ec9f2-3b1b-4289-9ba3-566c523348b5 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.458176 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a31b0-fd2d-4d20-967d-0b884b83ca30 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.458474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a31b0-fd2d-4d20-967d-0b884b83ca30 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.458723 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a31b0-fd2d-4d20-967d-0b884b83ca30 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.459990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ec9f2-3b1b-4289-9ba3-566c523348b5 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.460846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 295/587] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:20.465540 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a31b0-fd2d-4d20-967d-0b884b83ca30 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.468593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf51059-c108-4b1e-a684-9bc6bb1917f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.469586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf51059-c108-4b1e-a684-9bc6bb1917f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.469996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf51059-c108-4b1e-a684-9bc6bb1917f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.470276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf51059-c108-4b1e-a684-9bc6bb1917f7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.480385 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a31b0-fd2d-4d20-967d-0b884b83ca30 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.484771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf51059-c108-4b1e-a684-9bc6bb1917f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.485303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d710b5b-c5cd-4913-a91b-5c710df02c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.486304 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d710b5b-c5cd-4913-a91b-5c710df02c40 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.486583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d710b5b-c5cd-4913-a91b-5c710df02c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.486856 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d710b5b-c5cd-4913-a91b-5c710df02c40 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.487023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf51059-c108-4b1e-a684-9bc6bb1917f7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.487608 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d710b5b-c5cd-4913-a91b-5c710df02c40 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.489252 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-9d710b5b-c5cd-4913-a91b-5c710df02c40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:20.489252 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:18:20.489252 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:18:20.490140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d710b5b-c5cd-4913-a91b-5c710df02c40 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.501255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-ccf51059-c108-4b1e-a684-9bc6bb1917f7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:20.502811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 293/588] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:20.504024 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455936b-50a1-44f2-8b3f-467500bf13d6 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.504135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-9d710b5b-c5cd-4913-a91b-5c710df02c40 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 14:18:20.504310 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455936b-50a1-44f2-8b3f-467500bf13d6 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.504575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455936b-50a1-44f2-8b3f-467500bf13d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.511181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 296/589] 10.222.0.16 () {56 vars in 1151 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:20.512021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d710b5b-c5cd-4913-a91b-5c710df02c40 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.527415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d710b5b-c5cd-4913-a91b-5c710df02c40 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.531957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd17cb-0ba8-4212-961a-b9a53f6b6dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.532129 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3455936b-50a1-44f2-8b3f-467500bf13d6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:20.532602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd17cb-0ba8-4212-961a-b9a53f6b6dcf admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.532882 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd17cb-0ba8-4212-961a-b9a53f6b6dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.533156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd17cb-0ba8-4212-961a-b9a53f6b6dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.533252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3455936b-50a1-44f2-8b3f-467500bf13d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:20.533958 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd17cb-0ba8-4212-961a-b9a53f6b6dcf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:20.534377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd17cb-0ba8-4212-961a-b9a53f6b6dcf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.537194 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd17cb-0ba8-4212-961a-b9a53f6b6dcf admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.541789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 294/590] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:20.542620 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455936b-50a1-44f2-8b3f-467500bf13d6 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.550337 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 297/591] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:20.557374 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd17cb-0ba8-4212-961a-b9a53f6b6dcf admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.559717 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455936b-50a1-44f2-8b3f-467500bf13d6 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.567199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd17cb-0ba8-4212-961a-b9a53f6b6dcf admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.572039 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847a92b-270c-4917-9257-aca0b0929dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.572724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847a92b-270c-4917-9257-aca0b0929dfb admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.573007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847a92b-270c-4917-9257-aca0b0929dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.573335 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847a92b-270c-4917-9257-aca0b0929dfb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.574234 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847a92b-270c-4917-9257-aca0b0929dfb admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=d8c0afa8f09f4923b9c8ab2696156129) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:20.574644 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847a92b-270c-4917-9257-aca0b0929dfb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.576814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847a92b-270c-4917-9257-aca0b0929dfb admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.579128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aed3ab-24c3-4ffd-b8b4-6d1e50b19378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.579805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed3ab-24c3-4ffd-b8b4-6d1e50b19378 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.580085 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed3ab-24c3-4ffd-b8b4-6d1e50b19378 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.580361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed3ab-24c3-4ffd-b8b4-6d1e50b19378 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.581062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aed3ab-24c3-4ffd-b8b4-6d1e50b19378 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:20.581365 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aed3ab-24c3-4ffd-b8b4-6d1e50b19378 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.582492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-56aed3ab-24c3-4ffd-b8b4-6d1e50b19378 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:20.582492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:18:20.582492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:18:20.583388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aed3ab-24c3-4ffd-b8b4-6d1e50b19378 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.589424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 298/592] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/role_assignments?user.id=d8c0afa8f09f4923b9c8ab2696156129&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:20.590894 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847a92b-270c-4917-9257-aca0b0929dfb admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.592116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 295/593] 10.222.0.16 () {56 vars in 1146 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:20.601017 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aed3ab-24c3-4ffd-b8b4-6d1e50b19378 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.605528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847a92b-270c-4917-9257-aca0b0929dfb admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.614453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc5d56-d847-436a-a0c0-e4474bf75751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.615256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc5d56-d847-436a-a0c0-e4474bf75751 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.615536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc5d56-d847-436a-a0c0-e4474bf75751 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.615806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc5d56-d847-436a-a0c0-e4474bf75751 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.617945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aed3ab-24c3-4ffd-b8b4-6d1e50b19378 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.632609 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca730b4-38e7-43ca-aeb5-9cac4656a5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.633713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca730b4-38e7-43ca-aeb5-9cac4656a5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.634507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca730b4-38e7-43ca-aeb5-9cac4656a5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.634974 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca730b4-38e7-43ca-aeb5-9cac4656a5e3 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.637997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca730b4-38e7-43ca-aeb5-9cac4656a5e3 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:20.638640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca730b4-38e7-43ca-aeb5-9cac4656a5e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.640770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca730b4-38e7-43ca-aeb5-9cac4656a5e3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.644510 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc5d56-d847-436a-a0c0-e4474bf75751 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.650317 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc5d56-d847-436a-a0c0-e4474bf75751 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.666394 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 296/594] 10.222.0.16 () {56 vars in 1146 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:20.681532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-46dc5d56-d847-436a-a0c0-e4474bf75751 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:20.683689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 299/595] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:20.690529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca730b4-38e7-43ca-aeb5-9cac4656a5e3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.701620 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca730b4-38e7-43ca-aeb5-9cac4656a5e3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.711397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3d802-c3bb-4fcc-baf9-34d8035d676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.712476 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3d802-c3bb-4fcc-baf9-34d8035d676b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.713031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3d802-c3bb-4fcc-baf9-34d8035d676b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.713498 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3d802-c3bb-4fcc-baf9-34d8035d676b admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.714537 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3d802-c3bb-4fcc-baf9-34d8035d676b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:20.715093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3d802-c3bb-4fcc-baf9-34d8035d676b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.717269 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3d802-c3bb-4fcc-baf9-34d8035d676b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.743340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 297/596] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:20.749757 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc5d56-d847-436a-a0c0-e4474bf75751 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:20.761367 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc5d56-d847-436a-a0c0-e4474bf75751 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:20.771178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8168e31-2c69-47f2-9f56-9156503ee238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:20.772286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168e31-2c69-47f2-9f56-9156503ee238 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:20.772886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168e31-2c69-47f2-9f56-9156503ee238 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:20.773351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168e31-2c69-47f2-9f56-9156503ee238 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:20.774352 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8168e31-2c69-47f2-9f56-9156503ee238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:20.776523 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8168e31-2c69-47f2-9f56-9156503ee238 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:20.873273 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 300/597] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:18:20 2021] POST /identity/v3/users => generated 254 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:18:21.065855 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081f509-1f21-4e5e-90d9-37f46f255d59 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:21.066489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081f509-1f21-4e5e-90d9-37f46f255d59 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:21.066788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081f509-1f21-4e5e-90d9-37f46f255d59 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:21.068913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 298/598] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:21.075065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115325b5-eb0b-411b-a74f-53d1d6cf3390 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:21.075489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115325b5-eb0b-411b-a74f-53d1d6cf3390 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:21.075914 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115325b5-eb0b-411b-a74f-53d1d6cf3390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:21.097141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-115325b5-eb0b-411b-a74f-53d1d6cf3390 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:21.099509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-115325b5-eb0b-411b-a74f-53d1d6cf3390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:21.111646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 301/599] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:21.135222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081f509-1f21-4e5e-90d9-37f46f255d59 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:21.151669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081f509-1f21-4e5e-90d9-37f46f255d59 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:21.155997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52ff81-99be-402b-8e2e-f31ec824f306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:21.156790 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52ff81-99be-402b-8e2e-f31ec824f306 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:21.157069 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52ff81-99be-402b-8e2e-f31ec824f306 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:21.157343 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52ff81-99be-402b-8e2e-f31ec824f306 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:21.158029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52ff81-99be-402b-8e2e-f31ec824f306 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:21.159032 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-7e52ff81-99be-402b-8e2e-f31ec824f306 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:21.159032 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:18:21.159032 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:18:21.159923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52ff81-99be-402b-8e2e-f31ec824f306 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:21.172887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-7e52ff81-99be-402b-8e2e-f31ec824f306 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 14:18:21.174427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 299/600] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:21 2021] GET /identity/v3/services/network => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:21.181081 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115325b5-eb0b-411b-a74f-53d1d6cf3390 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:21.190399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115325b5-eb0b-411b-a74f-53d1d6cf3390 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:21.198434 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381541f-7218-4128-ab52-84cbe8b168b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:21.199287 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381541f-7218-4128-ab52-84cbe8b168b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:21.199714 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381541f-7218-4128-ab52-84cbe8b168b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:21.200124 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381541f-7218-4128-ab52-84cbe8b168b3 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:21.200966 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381541f-7218-4128-ab52-84cbe8b168b3 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:21.201430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381541f-7218-4128-ab52-84cbe8b168b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:21.202601 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-1381541f-7218-4128-ab52-84cbe8b168b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:21.202601 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:18:21.202601 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:18:21.203738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381541f-7218-4128-ab52-84cbe8b168b3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:21.211499 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 302/601] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:21 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:21.217915 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52ff81-99be-402b-8e2e-f31ec824f306 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:21.228642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52ff81-99be-402b-8e2e-f31ec824f306 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:21.235778 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a28a3-9edb-48ad-97d5-d0ea2eb9c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:21.236611 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a28a3-9edb-48ad-97d5-d0ea2eb9c48f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:21.237028 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a28a3-9edb-48ad-97d5-d0ea2eb9c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:21.237458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a28a3-9edb-48ad-97d5-d0ea2eb9c48f admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:21.238522 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a28a3-9edb-48ad-97d5-d0ea2eb9c48f admin admin] RBAC: Adding query filter params (type=network) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:21.238974 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a28a3-9edb-48ad-97d5-d0ea2eb9c48f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:21.240698 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a28a3-9edb-48ad-97d5-d0ea2eb9c48f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:21.252130 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 300/602] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:21 2021] GET /identity/v3/services?type=network => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:21.698176 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fe1b3-b2da-41d8-93ed-0e0b15f706a6 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:21.698465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fe1b3-b2da-41d8-93ed-0e0b15f706a6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:21.698747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fe1b3-b2da-41d8-93ed-0e0b15f706a6 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:21.700913 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 303/603] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:21.706486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124321b-bc76-496b-a2f0-03d5eb35906f None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:21.707309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124321b-bc76-496b-a2f0-03d5eb35906f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:21.707750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124321b-bc76-496b-a2f0-03d5eb35906f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:21.730822 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-e124321b-bc76-496b-a2f0-03d5eb35906f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:21.732021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e124321b-bc76-496b-a2f0-03d5eb35906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:21.740339 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 301/604] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:21.777156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fe1b3-b2da-41d8-93ed-0e0b15f706a6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:21.795411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fe1b3-b2da-41d8-93ed-0e0b15f706a6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:21.800198 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb10798-a9d1-47c7-8b7b-a778d660db73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:21.801530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb10798-a9d1-47c7-8b7b-a778d660db73 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:21.801800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb10798-a9d1-47c7-8b7b-a778d660db73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:21.802088 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb10798-a9d1-47c7-8b7b-a778d660db73 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:21.816688 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb10798-a9d1-47c7-8b7b-a778d660db73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:21.823639 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-fcb10798-a9d1-47c7-8b7b-a778d660db73 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:21.825134 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 304/605] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:21.835143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124321b-bc76-496b-a2f0-03d5eb35906f None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:21.844236 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124321b-bc76-496b-a2f0-03d5eb35906f None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:21.852172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c2b6e-edf2-4a9a-9a9d-fb9904278ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:21.852900 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c2b6e-edf2-4a9a-9a9d-fb9904278ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:21.853188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c2b6e-edf2-4a9a-9a9d-fb9904278ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:21.853461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c2b6e-edf2-4a9a-9a9d-fb9904278ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:21.854308 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c2b6e-edf2-4a9a-9a9d-fb9904278ac0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:21.854609 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c2b6e-edf2-4a9a-9a9d-fb9904278ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:21.856249 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c2b6e-edf2-4a9a-9a9d-fb9904278ac0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:21.865983 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 302/606] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:21.871747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb10798-a9d1-47c7-8b7b-a778d660db73 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:21.881555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb10798-a9d1-47c7-8b7b-a778d660db73 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:21.890082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991bf0-a516-48fe-b069-2b4fd7539562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:21.890864 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991bf0-a516-48fe-b069-2b4fd7539562 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:21.891136 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991bf0-a516-48fe-b069-2b4fd7539562 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:21.891400 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991bf0-a516-48fe-b069-2b4fd7539562 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:21.904936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84991bf0-a516-48fe-b069-2b4fd7539562 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:21.906880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84991bf0-a516-48fe-b069-2b4fd7539562 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:21.934897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-84991bf0-a516-48fe-b069-2b4fd7539562 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:21.937610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 305/607] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:21.943519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c2b6e-edf2-4a9a-9a9d-fb9904278ac0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:21.954736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c2b6e-edf2-4a9a-9a9d-fb9904278ac0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:21.965879 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab93737-fe4c-4fcc-a61b-10ee41934f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:21.966552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab93737-fe4c-4fcc-a61b-10ee41934f69 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:21.966832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab93737-fe4c-4fcc-a61b-10ee41934f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:21.967164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab93737-fe4c-4fcc-a61b-10ee41934f69 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:21.967892 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab93737-fe4c-4fcc-a61b-10ee41934f69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:21.968245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab93737-fe4c-4fcc-a61b-10ee41934f69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:21.969995 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab93737-fe4c-4fcc-a61b-10ee41934f69 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:21.988100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 303/608] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:21.994277 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991bf0-a516-48fe-b069-2b4fd7539562 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:22.005189 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991bf0-a516-48fe-b069-2b4fd7539562 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:22.014259 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab08eb-b2f4-4a87-bd11-2c37346a411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:22.015101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab08eb-b2f4-4a87-bd11-2c37346a411e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:22.015377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab08eb-b2f4-4a87-bd11-2c37346a411e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:22.015650 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab08eb-b2f4-4a87-bd11-2c37346a411e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:22.024811 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab08eb-b2f4-4a87-bd11-2c37346a411e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:22.026866 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab08eb-b2f4-4a87-bd11-2c37346a411e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:22.048294 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-78ab08eb-b2f4-4a87-bd11-2c37346a411e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 14:18:22.049793 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 306/609] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:21 2021] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:22.056472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab93737-fe4c-4fcc-a61b-10ee41934f69 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:22.066772 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab93737-fe4c-4fcc-a61b-10ee41934f69 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:22.074991 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a170faf-0075-4acb-842c-afd2285eca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:22.075709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a170faf-0075-4acb-842c-afd2285eca70 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:22.076039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a170faf-0075-4acb-842c-afd2285eca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:22.076309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a170faf-0075-4acb-842c-afd2285eca70 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:22.077144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a170faf-0075-4acb-842c-afd2285eca70 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:22.077444 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a170faf-0075-4acb-842c-afd2285eca70 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:22.079363 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a170faf-0075-4acb-842c-afd2285eca70 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:22.102583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 304/610] 10.222.0.16 () {56 vars in 1157 bytes} [Sun Aug 29 14:18:22 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:22.108839 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab08eb-b2f4-4a87-bd11-2c37346a411e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:22.119479 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab08eb-b2f4-4a87-bd11-2c37346a411e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:22.130274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f19a0d-aaa6-40aa-8c94-8568c7b73bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:22.130908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f19a0d-aaa6-40aa-8c94-8568c7b73bae admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:22.131221 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f19a0d-aaa6-40aa-8c94-8568c7b73bae admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:22.131500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f19a0d-aaa6-40aa-8c94-8568c7b73bae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:22.139970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f19a0d-aaa6-40aa-8c94-8568c7b73bae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:22.141803 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f19a0d-aaa6-40aa-8c94-8568c7b73bae admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:22.157224 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 307/611] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:22.163975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a170faf-0075-4acb-842c-afd2285eca70 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:22.178039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a170faf-0075-4acb-842c-afd2285eca70 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:22.185107 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e550f7-5e4e-4692-bf36-366dd92dc252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:22.185985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e550f7-5e4e-4692-bf36-366dd92dc252 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:22.186337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e550f7-5e4e-4692-bf36-366dd92dc252 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:22.186614 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e550f7-5e4e-4692-bf36-366dd92dc252 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:22.200411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e550f7-5e4e-4692-bf36-366dd92dc252 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:22.202399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e550f7-5e4e-4692-bf36-366dd92dc252 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:22.232289 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-10e550f7-5e4e-4692-bf36-366dd92dc252 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:22.233757 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 305/612] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:22.239752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f19a0d-aaa6-40aa-8c94-8568c7b73bae admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:22.261888 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f19a0d-aaa6-40aa-8c94-8568c7b73bae admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:22.274536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cc257-2de1-42d0-9fef-9e9f03847180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:22.275215 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cc257-2de1-42d0-9fef-9e9f03847180 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:22.275502 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cc257-2de1-42d0-9fef-9e9f03847180 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:22.275783 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cc257-2de1-42d0-9fef-9e9f03847180 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:22.276514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cc257-2de1-42d0-9fef-9e9f03847180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:22.276823 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cc257-2de1-42d0-9fef-9e9f03847180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:22.278462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cc257-2de1-42d0-9fef-9e9f03847180 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:22.292550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 308/613] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:22.298590 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e550f7-5e4e-4692-bf36-366dd92dc252 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:22.309316 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e550f7-5e4e-4692-bf36-366dd92dc252 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:22.320592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a175c7b-e78d-4007-bf6e-15b229b0b13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:22.321427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175c7b-e78d-4007-bf6e-15b229b0b13e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:22.321704 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175c7b-e78d-4007-bf6e-15b229b0b13e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:22.322090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175c7b-e78d-4007-bf6e-15b229b0b13e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:22.330239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a175c7b-e78d-4007-bf6e-15b229b0b13e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:22.332424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a175c7b-e78d-4007-bf6e-15b229b0b13e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:22.352861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-1a175c7b-e78d-4007-bf6e-15b229b0b13e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:22.354615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 306/614] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:22.360353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cc257-2de1-42d0-9fef-9e9f03847180 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:22.379421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cc257-2de1-42d0-9fef-9e9f03847180 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:22.394598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dca89-cc45-49a8-a3d3-1ee40d22d590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:22.395286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dca89-cc45-49a8-a3d3-1ee40d22d590 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:22.395571 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dca89-cc45-49a8-a3d3-1ee40d22d590 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:22.395927 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dca89-cc45-49a8-a3d3-1ee40d22d590 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:22.396727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dca89-cc45-49a8-a3d3-1ee40d22d590 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:22.397033 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dca89-cc45-49a8-a3d3-1ee40d22d590 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:22.398906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dca89-cc45-49a8-a3d3-1ee40d22d590 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:22.415199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 309/615] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:22.421628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a175c7b-e78d-4007-bf6e-15b229b0b13e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:22.437318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a175c7b-e78d-4007-bf6e-15b229b0b13e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:22.441877 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afdd31-7e52-4acb-9877-5abead44aed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:22.442546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afdd31-7e52-4acb-9877-5abead44aed7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:22.442825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afdd31-7e52-4acb-9877-5abead44aed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:22.443097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afdd31-7e52-4acb-9877-5abead44aed7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:22.443919 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afdd31-7e52-4acb-9877-5abead44aed7 admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=f37041a9727e4ab6a5c52b00327e7a19) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:22.444222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afdd31-7e52-4acb-9877-5abead44aed7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:22.446072 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afdd31-7e52-4acb-9877-5abead44aed7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:22.454851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 307/616] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:22 2021] GET /identity/v3/role_assignments?user.id=f37041a9727e4ab6a5c52b00327e7a19&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:23.053240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7c2aa-c5d6-4554-883d-ae5e7120a82f None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.053892 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7c2aa-c5d6-4554-883d-ae5e7120a82f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.053892 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7c2aa-c5d6-4554-883d-ae5e7120a82f None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.055841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 310/617] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:23.062142 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12fb29-c6ba-4dbb-a21a-a4b6dfbf2776 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.062435 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12fb29-c6ba-4dbb-a21a-a4b6dfbf2776 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.062716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12fb29-c6ba-4dbb-a21a-a4b6dfbf2776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.083523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-fb12fb29-c6ba-4dbb-a21a-a4b6dfbf2776 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:23.084734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-fb12fb29-c6ba-4dbb-a21a-a4b6dfbf2776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:23.095410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 308/618] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:23.120559 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7c2aa-c5d6-4554-883d-ae5e7120a82f None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:23.133539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7c2aa-c5d6-4554-883d-ae5e7120a82f None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:23.139856 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca22ee2-8636-414e-899f-8f6f0fcf1edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:23.140647 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22ee2-8636-414e-899f-8f6f0fcf1edd admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.140926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22ee2-8636-414e-899f-8f6f0fcf1edd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.141197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22ee2-8636-414e-899f-8f6f0fcf1edd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.155147 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca22ee2-8636-414e-899f-8f6f0fcf1edd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:23.162836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-3ca22ee2-8636-414e-899f-8f6f0fcf1edd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:18:23.164105 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 311/619] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:23.170693 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12fb29-c6ba-4dbb-a21a-a4b6dfbf2776 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:23.181369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12fb29-c6ba-4dbb-a21a-a4b6dfbf2776 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:23.189135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced53cf2-b02b-49e8-a30e-b3ef1ab04407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:23.189812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced53cf2-b02b-49e8-a30e-b3ef1ab04407 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.190127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced53cf2-b02b-49e8-a30e-b3ef1ab04407 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.190405 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced53cf2-b02b-49e8-a30e-b3ef1ab04407 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.191204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced53cf2-b02b-49e8-a30e-b3ef1ab04407 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:23.191546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced53cf2-b02b-49e8-a30e-b3ef1ab04407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:23.193110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced53cf2-b02b-49e8-a30e-b3ef1ab04407 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:23.209098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 309/620] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:23.215063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca22ee2-8636-414e-899f-8f6f0fcf1edd admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:23.230831 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca22ee2-8636-414e-899f-8f6f0fcf1edd admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:23.240613 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37356b7-43bb-465a-8430-46417f621dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:23.241401 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37356b7-43bb-465a-8430-46417f621dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.241685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37356b7-43bb-465a-8430-46417f621dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.241988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37356b7-43bb-465a-8430-46417f621dd3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.245167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a131cad-63d3-4983-b8f8-84083acffde3 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.245454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a131cad-63d3-4983-b8f8-84083acffde3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.245733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a131cad-63d3-4983-b8f8-84083acffde3 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.247546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 310/621] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:23.253903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab458a9-0ecf-456f-8a3a-6853b3f48600 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.253903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab458a9-0ecf-456f-8a3a-6853b3f48600 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.254127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab458a9-0ecf-456f-8a3a-6853b3f48600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.262364 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37356b7-43bb-465a-8430-46417f621dd3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:23.264182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37356b7-43bb-465a-8430-46417f621dd3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:23.285265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0ab458a9-0ecf-456f-8a3a-6853b3f48600 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:23.286463 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0ab458a9-0ecf-456f-8a3a-6853b3f48600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:23.294630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-b37356b7-43bb-465a-8430-46417f621dd3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:23.297808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 312/622] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:23.304336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 311/623] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:23.310868 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37356b7-43bb-465a-8430-46417f621dd3 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:23.326886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37356b7-43bb-465a-8430-46417f621dd3 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:23.331748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab458a9-0ecf-456f-8a3a-6853b3f48600 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:23.334438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4d224-d4ba-487f-924c-706b6028c28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:23.335099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4d224-d4ba-487f-924c-706b6028c28b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.335374 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4d224-d4ba-487f-924c-706b6028c28b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.335639 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4d224-d4ba-487f-924c-706b6028c28b admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.336361 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4d224-d4ba-487f-924c-706b6028c28b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:23.336661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4d224-d4ba-487f-924c-706b6028c28b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:23.338296 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4d224-d4ba-487f-924c-706b6028c28b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:23.343619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab458a9-0ecf-456f-8a3a-6853b3f48600 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:23.352660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f96930-adcc-458f-a950-ac213774c25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:23.354894 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f96930-adcc-458f-a950-ac213774c25e admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.355402 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f96930-adcc-458f-a950-ac213774c25e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.356111 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f96930-adcc-458f-a950-ac213774c25e admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.358022 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f96930-adcc-458f-a950-ac213774c25e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:23.359981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-01f96930-adcc-458f-a950-ac213774c25e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:23.359981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:18:23.359981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:18:23.364257 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f96930-adcc-458f-a950-ac213774c25e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:23.367520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 313/624] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:23.378201 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4d224-d4ba-487f-924c-706b6028c28b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:23.389641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4d224-d4ba-487f-924c-706b6028c28b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:23.394528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d08ee-6fa5-409c-b2d7-9c4c80646fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:23.395513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d08ee-6fa5-409c-b2d7-9c4c80646fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.395951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d08ee-6fa5-409c-b2d7-9c4c80646fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.396379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d08ee-6fa5-409c-b2d7-9c4c80646fa9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.404947 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d08ee-6fa5-409c-b2d7-9c4c80646fa9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:23.407263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d08ee-6fa5-409c-b2d7-9c4c80646fa9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:23.421670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-b33d08ee-6fa5-409c-b2d7-9c4c80646fa9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 14:18:23.423418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 314/625] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Aug 29 14:18:23 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:23.430546 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d08ee-6fa5-409c-b2d7-9c4c80646fa9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:23.442245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d08ee-6fa5-409c-b2d7-9c4c80646fa9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:23.447012 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c4df1-fbdf-4c74-856d-1feb2e0b427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:23.447921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c4df1-fbdf-4c74-856d-1feb2e0b427f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.448409 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c4df1-fbdf-4c74-856d-1feb2e0b427f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.448873 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c4df1-fbdf-4c74-856d-1feb2e0b427f admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.449952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c4df1-fbdf-4c74-856d-1feb2e0b427f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:23.450473 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c4df1-fbdf-4c74-856d-1feb2e0b427f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:23.452542 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c4df1-fbdf-4c74-856d-1feb2e0b427f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:23.471460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 315/626] 10.222.0.16 () {56 vars in 1155 bytes} [Sun Aug 29 14:18:23 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:23.477774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c4df1-fbdf-4c74-856d-1feb2e0b427f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:23.487535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c4df1-fbdf-4c74-856d-1feb2e0b427f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:23.489275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 312/627] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:18:23 2021] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:18:23.524595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c562fc-b4d7-43f5-be02-65e558af2b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:23.525505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c562fc-b4d7-43f5-be02-65e558af2b74 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.525781 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c562fc-b4d7-43f5-be02-65e558af2b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.526084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c562fc-b4d7-43f5-be02-65e558af2b74 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.542285 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c562fc-b4d7-43f5-be02-65e558af2b74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:23.544339 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c562fc-b4d7-43f5-be02-65e558af2b74 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:23.566834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-b0c562fc-b4d7-43f5-be02-65e558af2b74 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:23.568078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 316/628] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:23.574372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f96930-adcc-458f-a950-ac213774c25e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:23.591967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f96930-adcc-458f-a950-ac213774c25e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:23.602060 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624155fd-c3ce-465d-9c91-61782f144e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:23.602749 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624155fd-c3ce-465d-9c91-61782f144e01 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.603026 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624155fd-c3ce-465d-9c91-61782f144e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.603299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624155fd-c3ce-465d-9c91-61782f144e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.604035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624155fd-c3ce-465d-9c91-61782f144e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:23.604341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624155fd-c3ce-465d-9c91-61782f144e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:23.605997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624155fd-c3ce-465d-9c91-61782f144e01 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:23.625255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 313/629] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:23.632061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c562fc-b4d7-43f5-be02-65e558af2b74 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:23.643190 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c562fc-b4d7-43f5-be02-65e558af2b74 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:23.647960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea9203-f868-4b0a-b69c-a0546491a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:23.648772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea9203-f868-4b0a-b69c-a0546491a542 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.649051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea9203-f868-4b0a-b69c-a0546491a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.649324 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea9203-f868-4b0a-b69c-a0546491a542 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.657209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea9203-f868-4b0a-b69c-a0546491a542 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:23.659220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea9203-f868-4b0a-b69c-a0546491a542 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:23.674359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-37ea9203-f868-4b0a-b69c-a0546491a542 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:23.676673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 317/630] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:23.682671 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624155fd-c3ce-465d-9c91-61782f144e01 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:23.693251 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624155fd-c3ce-465d-9c91-61782f144e01 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:23.701810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedc078-63f1-40e0-aeeb-ce1423fa09d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:23.702511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedc078-63f1-40e0-aeeb-ce1423fa09d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.702789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedc078-63f1-40e0-aeeb-ce1423fa09d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.703062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedc078-63f1-40e0-aeeb-ce1423fa09d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.703857 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedc078-63f1-40e0-aeeb-ce1423fa09d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:23.704161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedc078-63f1-40e0-aeeb-ce1423fa09d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:23.706061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedc078-63f1-40e0-aeeb-ce1423fa09d0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:23.719778 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 314/631] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:23.726448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea9203-f868-4b0a-b69c-a0546491a542 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:23.736378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea9203-f868-4b0a-b69c-a0546491a542 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:23.740936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddb311-f240-42e8-bfa4-0d0752bb0f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:23.741876 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddb311-f240-42e8-bfa4-0d0752bb0f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.742167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddb311-f240-42e8-bfa4-0d0752bb0f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.742487 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddb311-f240-42e8-bfa4-0d0752bb0f1c admin admin] PATH_INFO: `/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/d8c0afa8f09f4923b9c8ab2696156129/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.744480 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddb311-f240-42e8-bfa4-0d0752bb0f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c728e9160de45afbd4902c27eef45b3, user_id=d8c0afa8f09f4923b9c8ab2696156129, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:23.747257 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddb311-f240-42e8-bfa4-0d0752bb0f1c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:23.823970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 318/632] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:18:23 2021] PUT /identity/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/d8c0afa8f09f4923b9c8ab2696156129/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:18:23.967444 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fb3f4-f011-41be-ab13-26f11bb1830c None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.968093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fb3f4-f011-41be-ab13-26f11bb1830c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.968600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fb3f4-f011-41be-ab13-26f11bb1830c None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:23.971108 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 315/633] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:23.977695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e078b-e7d1-4262-a7f4-22da42e44fa8 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:23.978280 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e078b-e7d1-4262-a7f4-22da42e44fa8 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:23.978733 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e078b-e7d1-4262-a7f4-22da42e44fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.004056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-165e078b-e7d1-4262-a7f4-22da42e44fa8 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:24.005561 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-165e078b-e7d1-4262-a7f4-22da42e44fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:24.049902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e7dad-ac07-4386-ba46-a77e22e2b03e None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.049902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e7dad-ac07-4386-ba46-a77e22e2b03e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.049902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e7dad-ac07-4386-ba46-a77e22e2b03e None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.049902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 316/634] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:24.054854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4449-f672-490b-b1c2-cf8ba02a7ed0 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.055141 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4449-f672-490b-b1c2-cf8ba02a7ed0 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.055420 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4449-f672-490b-b1c2-cf8ba02a7ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.078440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-25ac4449-f672-490b-b1c2-cf8ba02a7ed0 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:24.079670 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-25ac4449-f672-490b-b1c2-cf8ba02a7ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:24.096474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 319/635] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:23 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:24.121159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e078b-e7d1-4262-a7f4-22da42e44fa8 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.130514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e078b-e7d1-4262-a7f4-22da42e44fa8 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.146591 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7f489-968c-41b4-9d05-907422853434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.147271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7f489-968c-41b4-9d05-907422853434 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.147550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7f489-968c-41b4-9d05-907422853434 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.147826 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7f489-968c-41b4-9d05-907422853434 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.148554 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7f489-968c-41b4-9d05-907422853434 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:24.149563 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-3dc7f489-968c-41b4-9d05-907422853434 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:24.149563 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:18:24.149563 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:18:24.150503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7f489-968c-41b4-9d05-907422853434 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:24.175653 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 317/636] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:24 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:24.201743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac4449-f672-490b-b1c2-cf8ba02a7ed0 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.211799 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac4449-f672-490b-b1c2-cf8ba02a7ed0 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.221907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 320/637] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:18:24 2021] POST /identity/v3/services => generated 240 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:24.240828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b93ba-8b0f-47ee-9adb-fd3d8c56bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.241622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b93ba-8b0f-47ee-9adb-fd3d8c56bcfe admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.241996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b93ba-8b0f-47ee-9adb-fd3d8c56bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.242332 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b93ba-8b0f-47ee-9adb-fd3d8c56bcfe admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.259200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b93ba-8b0f-47ee-9adb-fd3d8c56bcfe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:24.266853 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-384b93ba-8b0f-47ee-9adb-fd3d8c56bcfe admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:24.268114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 318/638] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:24.275306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7f489-968c-41b4-9d05-907422853434 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.289516 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7f489-968c-41b4-9d05-907422853434 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.296004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aca56f-6c27-44ed-a0b1-153d2983cb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.296698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aca56f-6c27-44ed-a0b1-153d2983cb18 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.296989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aca56f-6c27-44ed-a0b1-153d2983cb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.297293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aca56f-6c27-44ed-a0b1-153d2983cb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.298084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aca56f-6c27-44ed-a0b1-153d2983cb18 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:24.298444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aca56f-6c27-44ed-a0b1-153d2983cb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:24.300247 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aca56f-6c27-44ed-a0b1-153d2983cb18 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:24.314347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 321/639] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:24.320792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b93ba-8b0f-47ee-9adb-fd3d8c56bcfe admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.332825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b93ba-8b0f-47ee-9adb-fd3d8c56bcfe admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.341037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c3fe3-262b-46f4-8925-71f9d633205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.341932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c3fe3-262b-46f4-8925-71f9d633205d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.342219 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c3fe3-262b-46f4-8925-71f9d633205d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.342499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c3fe3-262b-46f4-8925-71f9d633205d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.358540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c3fe3-262b-46f4-8925-71f9d633205d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:24.360473 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c3fe3-262b-46f4-8925-71f9d633205d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:24.383030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-479c3fe3-262b-46f4-8925-71f9d633205d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:24.385881 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 319/640] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:24.392086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aca56f-6c27-44ed-a0b1-153d2983cb18 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.402641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aca56f-6c27-44ed-a0b1-153d2983cb18 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.407331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a4e2f-d745-45a5-831a-e8d58d1c4b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.408047 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a4e2f-d745-45a5-831a-e8d58d1c4b2d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.408327 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a4e2f-d745-45a5-831a-e8d58d1c4b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.408605 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a4e2f-d745-45a5-831a-e8d58d1c4b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.409391 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a4e2f-d745-45a5-831a-e8d58d1c4b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:24.409775 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a4e2f-d745-45a5-831a-e8d58d1c4b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:24.411611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a4e2f-d745-45a5-831a-e8d58d1c4b2d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:24.430039 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 322/641] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:24.433014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c3fe3-262b-46f4-8925-71f9d633205d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.443955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c3fe3-262b-46f4-8925-71f9d633205d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.448604 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a34367-2e4b-4219-8c8f-2f9052008052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.449482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a34367-2e4b-4219-8c8f-2f9052008052 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.449765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a34367-2e4b-4219-8c8f-2f9052008052 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.450073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a34367-2e4b-4219-8c8f-2f9052008052 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.460672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a34367-2e4b-4219-8c8f-2f9052008052 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:24.462880 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a34367-2e4b-4219-8c8f-2f9052008052 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:24.478787 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-e0a34367-2e4b-4219-8c8f-2f9052008052 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 14:18:24.483875 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 320/642] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Aug 29 14:18:24 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:24.486755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a4e2f-d745-45a5-831a-e8d58d1c4b2d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.499800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a4e2f-d745-45a5-831a-e8d58d1c4b2d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.505064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b40e8-21ee-47fc-af15-a56f3975b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.505782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b40e8-21ee-47fc-af15-a56f3975b63d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.506101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b40e8-21ee-47fc-af15-a56f3975b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.506427 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b40e8-21ee-47fc-af15-a56f3975b63d admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.507313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b40e8-21ee-47fc-af15-a56f3975b63d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:24.507617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b40e8-21ee-47fc-af15-a56f3975b63d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:24.509804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b40e8-21ee-47fc-af15-a56f3975b63d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:24.531041 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 323/643] 10.222.0.16 () {56 vars in 1171 bytes} [Sun Aug 29 14:18:24 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:24.535271 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a34367-2e4b-4219-8c8f-2f9052008052 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.546077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a34367-2e4b-4219-8c8f-2f9052008052 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.551282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dc722-e5bb-4bac-bb7a-30461ee5d49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.551983 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dc722-e5bb-4bac-bb7a-30461ee5d49e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.552262 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dc722-e5bb-4bac-bb7a-30461ee5d49e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.552536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dc722-e5bb-4bac-bb7a-30461ee5d49e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.561135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dc722-e5bb-4bac-bb7a-30461ee5d49e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:24.562957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dc722-e5bb-4bac-bb7a-30461ee5d49e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:24.572740 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 321/644] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:24 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:24.578886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b40e8-21ee-47fc-af15-a56f3975b63d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.590074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b40e8-21ee-47fc-af15-a56f3975b63d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.594651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84dac2-adcf-4eb3-a91c-de6f65ee4db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.595495 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84dac2-adcf-4eb3-a91c-de6f65ee4db1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.595778 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84dac2-adcf-4eb3-a91c-de6f65ee4db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.596046 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84dac2-adcf-4eb3-a91c-de6f65ee4db1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.606849 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84dac2-adcf-4eb3-a91c-de6f65ee4db1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:24.608668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84dac2-adcf-4eb3-a91c-de6f65ee4db1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:24.626608 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-8a84dac2-adcf-4eb3-a91c-de6f65ee4db1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:24.633048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 324/645] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:24.634719 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dc722-e5bb-4bac-bb7a-30461ee5d49e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.645915 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dc722-e5bb-4bac-bb7a-30461ee5d49e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.651130 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be7eba-a89b-45a6-b25d-573d329ac3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.651832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be7eba-a89b-45a6-b25d-573d329ac3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.652115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be7eba-a89b-45a6-b25d-573d329ac3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.652388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be7eba-a89b-45a6-b25d-573d329ac3d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.653099 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be7eba-a89b-45a6-b25d-573d329ac3d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:24.653400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be7eba-a89b-45a6-b25d-573d329ac3d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:24.655001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be7eba-a89b-45a6-b25d-573d329ac3d5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:24.673091 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 322/646] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:24.674433 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84dac2-adcf-4eb3-a91c-de6f65ee4db1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.690733 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84dac2-adcf-4eb3-a91c-de6f65ee4db1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.697827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9847546-4b11-42a9-a97f-0fcef19b236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.698634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9847546-4b11-42a9-a97f-0fcef19b236b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.698908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9847546-4b11-42a9-a97f-0fcef19b236b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.699308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9847546-4b11-42a9-a97f-0fcef19b236b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.711698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9847546-4b11-42a9-a97f-0fcef19b236b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:24.713625 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9847546-4b11-42a9-a97f-0fcef19b236b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:24.730058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-f9847546-4b11-42a9-a97f-0fcef19b236b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:24.731545 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 325/647] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:24.737664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be7eba-a89b-45a6-b25d-573d329ac3d5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.754866 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be7eba-a89b-45a6-b25d-573d329ac3d5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.762359 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332abab-1d35-4a10-94b0-0e62786b3c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.763023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332abab-1d35-4a10-94b0-0e62786b3c31 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.763305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332abab-1d35-4a10-94b0-0e62786b3c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.763626 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332abab-1d35-4a10-94b0-0e62786b3c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.764415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332abab-1d35-4a10-94b0-0e62786b3c31 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:24.764719 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332abab-1d35-4a10-94b0-0e62786b3c31 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:24.766599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332abab-1d35-4a10-94b0-0e62786b3c31 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:24.789113 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 323/648] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:24.795720 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9847546-4b11-42a9-a97f-0fcef19b236b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:24.809078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9847546-4b11-42a9-a97f-0fcef19b236b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:24.818094 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96d247-9d0b-40c6-ae37-74c02905f738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:24.818739 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d247-9d0b-40c6-ae37-74c02905f738 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:24.819015 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d247-9d0b-40c6-ae37-74c02905f738 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:24.819287 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d247-9d0b-40c6-ae37-74c02905f738 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:24.820118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96d247-9d0b-40c6-ae37-74c02905f738 admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=afee50dd81e5484081d4aef1c119a129) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:24.820580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96d247-9d0b-40c6-ae37-74c02905f738 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:24.822425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96d247-9d0b-40c6-ae37-74c02905f738 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:24.830159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 326/649] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:24 2021] GET /identity/v3/role_assignments?user.id=afee50dd81e5484081d4aef1c119a129&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:25.618355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90702b32-e9ba-44ac-afa8-76b2d3de1448 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:25.619113 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90702b32-e9ba-44ac-afa8-76b2d3de1448 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:25.619113 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90702b32-e9ba-44ac-afa8-76b2d3de1448 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:25.621000 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 324/650] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:25.627523 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572b03-dd68-4198-afc2-a262c033ed36 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:25.628086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572b03-dd68-4198-afc2-a262c033ed36 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:25.628086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572b03-dd68-4198-afc2-a262c033ed36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:25.658137 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-09572b03-dd68-4198-afc2-a262c033ed36 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:25.659355 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-09572b03-dd68-4198-afc2-a262c033ed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:25.669086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 327/651] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:25 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:25.713637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90702b32-e9ba-44ac-afa8-76b2d3de1448 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:25.728726 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90702b32-e9ba-44ac-afa8-76b2d3de1448 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:25.735621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396360a-c183-4369-86a1-8ad35e7abf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:25.736652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396360a-c183-4369-86a1-8ad35e7abf6c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:25.737130 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396360a-c183-4369-86a1-8ad35e7abf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:25.737595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396360a-c183-4369-86a1-8ad35e7abf6c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:25.759024 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396360a-c183-4369-86a1-8ad35e7abf6c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:25.766101 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-a396360a-c183-4369-86a1-8ad35e7abf6c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:18:25.767487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 325/652] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:25.774531 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09572b03-dd68-4198-afc2-a262c033ed36 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:25.787379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09572b03-dd68-4198-afc2-a262c033ed36 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:25.800937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f9d16-a7fc-448f-b877-c79dfa2d08a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:25.800937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f9d16-a7fc-448f-b877-c79dfa2d08a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:25.800937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f9d16-a7fc-448f-b877-c79dfa2d08a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:25.800937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f9d16-a7fc-448f-b877-c79dfa2d08a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:25.802050 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f9d16-a7fc-448f-b877-c79dfa2d08a6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:25.802438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f9d16-a7fc-448f-b877-c79dfa2d08a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:25.804814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f9d16-a7fc-448f-b877-c79dfa2d08a6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:25.824347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 328/653] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:25.830899 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396360a-c183-4369-86a1-8ad35e7abf6c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:25.847972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396360a-c183-4369-86a1-8ad35e7abf6c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:25.868082 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361d45e-ea81-48e6-9bd6-b0678cd8396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:25.870355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361d45e-ea81-48e6-9bd6-b0678cd8396d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:25.870958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361d45e-ea81-48e6-9bd6-b0678cd8396d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:25.871440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361d45e-ea81-48e6-9bd6-b0678cd8396d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:25.889853 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361d45e-ea81-48e6-9bd6-b0678cd8396d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:25.892045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361d45e-ea81-48e6-9bd6-b0678cd8396d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:25.915630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-a361d45e-ea81-48e6-9bd6-b0678cd8396d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:25.917346 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 326/654] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:25.924369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f9d16-a7fc-448f-b877-c79dfa2d08a6 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:25.947266 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f9d16-a7fc-448f-b877-c79dfa2d08a6 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:25.959651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a2959-9c34-4eeb-aa77-fc4c1fd8200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:25.960345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a2959-9c34-4eeb-aa77-fc4c1fd8200b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:25.960632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a2959-9c34-4eeb-aa77-fc4c1fd8200b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:25.960909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a2959-9c34-4eeb-aa77-fc4c1fd8200b admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:25.961800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a2959-9c34-4eeb-aa77-fc4c1fd8200b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:25.962143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a2959-9c34-4eeb-aa77-fc4c1fd8200b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:25.963743 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a2959-9c34-4eeb-aa77-fc4c1fd8200b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:25.983290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 329/655] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:25.990908 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361d45e-ea81-48e6-9bd6-b0678cd8396d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.007856 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361d45e-ea81-48e6-9bd6-b0678cd8396d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.018213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169155cb-4435-4de3-beaa-65ef2637c1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.019818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169155cb-4435-4de3-beaa-65ef2637c1cc admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.020549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169155cb-4435-4de3-beaa-65ef2637c1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.021073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169155cb-4435-4de3-beaa-65ef2637c1cc admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.032579 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169155cb-4435-4de3-beaa-65ef2637c1cc admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.035595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169155cb-4435-4de3-beaa-65ef2637c1cc admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.057232 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-169155cb-4435-4de3-beaa-65ef2637c1cc admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 14:18:26.059025 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 327/656] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:25 2021] GET /identity/v3/users/swift => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:26.065120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a2959-9c34-4eeb-aa77-fc4c1fd8200b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.075308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a2959-9c34-4eeb-aa77-fc4c1fd8200b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.086804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176e4e4-20d2-4c2e-b552-219e0e625d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.087991 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176e4e4-20d2-4c2e-b552-219e0e625d36 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.088731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176e4e4-20d2-4c2e-b552-219e0e625d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.089389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176e4e4-20d2-4c2e-b552-219e0e625d36 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.090466 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176e4e4-20d2-4c2e-b552-219e0e625d36 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:26.090947 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176e4e4-20d2-4c2e-b552-219e0e625d36 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.092934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176e4e4-20d2-4c2e-b552-219e0e625d36 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.113596 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 330/657] 10.222.0.16 () {56 vars in 1157 bytes} [Sun Aug 29 14:18:26 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:26.119786 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169155cb-4435-4de3-beaa-65ef2637c1cc admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.130364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169155cb-4435-4de3-beaa-65ef2637c1cc admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.139128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401f43a-1d17-46b9-9a5e-298287938a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.140050 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401f43a-1d17-46b9-9a5e-298287938a89 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.140674 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401f43a-1d17-46b9-9a5e-298287938a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.141120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401f43a-1d17-46b9-9a5e-298287938a89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.153443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401f43a-1d17-46b9-9a5e-298287938a89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.155707 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401f43a-1d17-46b9-9a5e-298287938a89 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.172564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 328/658] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:26 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:18:26.184299 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176e4e4-20d2-4c2e-b552-219e0e625d36 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.195369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176e4e4-20d2-4c2e-b552-219e0e625d36 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.207342 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194eadbc-c8ae-4534-9586-083a97aa903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.209156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194eadbc-c8ae-4534-9586-083a97aa903a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.209952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194eadbc-c8ae-4534-9586-083a97aa903a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.210692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194eadbc-c8ae-4534-9586-083a97aa903a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.233630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194eadbc-c8ae-4534-9586-083a97aa903a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.237959 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194eadbc-c8ae-4534-9586-083a97aa903a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.251505 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccd7a6-b3e2-4fa4-afe8-90e4912a8184 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.252384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccd7a6-b3e2-4fa4-afe8-90e4912a8184 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.253195 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccd7a6-b3e2-4fa4-afe8-90e4912a8184 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.256825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 329/659] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:26 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:26.263925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ff07d-1ca5-4d32-8d10-31b7e5c5bf32 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.264702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ff07d-1ca5-4d32-8d10-31b7e5c5bf32 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.265445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ff07d-1ca5-4d32-8d10-31b7e5c5bf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.308200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-194eadbc-c8ae-4534-9586-083a97aa903a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:26.309717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 331/660] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:26.315677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194eadbc-c8ae-4534-9586-083a97aa903a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.324687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c67ff07d-1ca5-4d32-8d10-31b7e5c5bf32 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:26.327087 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c67ff07d-1ca5-4d32-8d10-31b7e5c5bf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:26.334685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194eadbc-c8ae-4534-9586-083a97aa903a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.343904 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 330/661] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:26 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:26.344035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6fc2a-164b-40eb-9830-9139c4ba6261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.344687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6fc2a-164b-40eb-9830-9139c4ba6261 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.344967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6fc2a-164b-40eb-9830-9139c4ba6261 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.345239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6fc2a-164b-40eb-9830-9139c4ba6261 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.346034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6fc2a-164b-40eb-9830-9139c4ba6261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:26.346335 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6fc2a-164b-40eb-9830-9139c4ba6261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.348029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6fc2a-164b-40eb-9830-9139c4ba6261 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.367582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 332/662] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:26.373916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ff07d-1ca5-4d32-8d10-31b7e5c5bf32 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.380928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6fc2a-164b-40eb-9830-9139c4ba6261 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.385704 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ff07d-1ca5-4d32-8d10-31b7e5c5bf32 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.395928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213984fe-c783-49c6-9598-89c16fa2e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.396734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213984fe-c783-49c6-9598-89c16fa2e742 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.397009 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213984fe-c783-49c6-9598-89c16fa2e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.397280 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213984fe-c783-49c6-9598-89c16fa2e742 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.403772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6fc2a-164b-40eb-9830-9139c4ba6261 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.413555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213984fe-c783-49c6-9598-89c16fa2e742 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.413811 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54b764-97e9-40d1-80c4-41962289f931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.414636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54b764-97e9-40d1-80c4-41962289f931 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.416185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54b764-97e9-40d1-80c4-41962289f931 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.416855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54b764-97e9-40d1-80c4-41962289f931 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.417517 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54b764-97e9-40d1-80c4-41962289f931 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.418736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213984fe-c783-49c6-9598-89c16fa2e742 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.421338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54b764-97e9-40d1-80c4-41962289f931 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.440251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-bd54b764-97e9-40d1-80c4-41962289f931 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 14:18:26.442804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 333/663] 10.222.0.16 () {56 vars in 1151 bytes} [Sun Aug 29 14:18:26 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:26.445954 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-213984fe-c783-49c6-9598-89c16fa2e742 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:26.450330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 331/664] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:26.456472 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54b764-97e9-40d1-80c4-41962289f931 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.458040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213984fe-c783-49c6-9598-89c16fa2e742 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.475044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213984fe-c783-49c6-9598-89c16fa2e742 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.479978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28228933-2883-415c-9ef6-eb98635550eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.480363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54b764-97e9-40d1-80c4-41962289f931 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.480844 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28228933-2883-415c-9ef6-eb98635550eb admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.481247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28228933-2883-415c-9ef6-eb98635550eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.481626 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28228933-2883-415c-9ef6-eb98635550eb admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.482479 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28228933-2883-415c-9ef6-eb98635550eb admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:26.482886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28228933-2883-415c-9ef6-eb98635550eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.484572 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28228933-2883-415c-9ef6-eb98635550eb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.490484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 332/665] 10.222.0.16 () {56 vars in 1146 bytes} [Sun Aug 29 14:18:26 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:26.504906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28228933-2883-415c-9ef6-eb98635550eb admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.505069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a9f38-75ac-462d-9493-f42106c38c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.505069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a9f38-75ac-462d-9493-f42106c38c6b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.505069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a9f38-75ac-462d-9493-f42106c38c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.505069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a9f38-75ac-462d-9493-f42106c38c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.505365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a9f38-75ac-462d-9493-f42106c38c6b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:26.505365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a9f38-75ac-462d-9493-f42106c38c6b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.505365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a9f38-75ac-462d-9493-f42106c38c6b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.516922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 334/666] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:26.521906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28228933-2883-415c-9ef6-eb98635550eb admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.524004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a9f38-75ac-462d-9493-f42106c38c6b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.535437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0af85-ff8f-4e21-b129-42c815ea5c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.536107 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0af85-ff8f-4e21-b129-42c815ea5c62 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.536385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0af85-ff8f-4e21-b129-42c815ea5c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.536651 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0af85-ff8f-4e21-b129-42c815ea5c62 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.538311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0af85-ff8f-4e21-b129-42c815ea5c62 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:26.538311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0af85-ff8f-4e21-b129-42c815ea5c62 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.539268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0af85-ff8f-4e21-b129-42c815ea5c62 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.542990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a9f38-75ac-462d-9493-f42106c38c6b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.548190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 333/667] 10.222.0.16 () {56 vars in 1146 bytes} [Sun Aug 29 14:18:26 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:26.552658 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ee304-8387-4c52-a3fa-e213aba3f10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.553321 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ee304-8387-4c52-a3fa-e213aba3f10c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.553600 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ee304-8387-4c52-a3fa-e213aba3f10c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.553991 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ee304-8387-4c52-a3fa-e213aba3f10c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.554877 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ee304-8387-4c52-a3fa-e213aba3f10c admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=f37041a9727e4ab6a5c52b00327e7a19) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:26.555373 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ee304-8387-4c52-a3fa-e213aba3f10c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.556345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0af85-ff8f-4e21-b129-42c815ea5c62 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.558673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ee304-8387-4c52-a3fa-e213aba3f10c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.565088 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 335/668] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:26 2021] GET /identity/v3/role_assignments?user.id=f37041a9727e4ab6a5c52b00327e7a19&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:26.576637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0af85-ff8f-4e21-b129-42c815ea5c62 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.591902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96369371-4307-40e8-a121-c69bedafc9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.592969 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96369371-4307-40e8-a121-c69bedafc9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.593454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96369371-4307-40e8-a121-c69bedafc9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.593958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96369371-4307-40e8-a121-c69bedafc9e5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.595021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96369371-4307-40e8-a121-c69bedafc9e5 admin admin] RBAC: Adding query filter params (interface=public, service_id=39bdbaa332db45c691b729ddc5590b33, region_id=RegionOne) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:26.595548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96369371-4307-40e8-a121-c69bedafc9e5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.596794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-96369371-4307-40e8-a121-c69bedafc9e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:26.596794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:18:26.596794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:18:26.598142 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96369371-4307-40e8-a121-c69bedafc9e5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.608839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 334/669] 10.222.0.16 () {56 vars in 1273 bytes} [Sun Aug 29 14:18:26 2021] GET /identity/v3/endpoints?service_id=39bdbaa332db45c691b729ddc5590b33&interface=public®ion_id=RegionOne => generated 194 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:26.614934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ee304-8387-4c52-a3fa-e213aba3f10c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:26.631445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ee304-8387-4c52-a3fa-e213aba3f10c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:26.639652 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162debb1-e8cd-4e72-94c5-17e5e407571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:26.640384 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162debb1-e8cd-4e72-94c5-17e5e407571f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.640664 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162debb1-e8cd-4e72-94c5-17e5e407571f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.640939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162debb1-e8cd-4e72-94c5-17e5e407571f admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.641689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162debb1-e8cd-4e72-94c5-17e5e407571f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:26.643373 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162debb1-e8cd-4e72-94c5-17e5e407571f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:26.649583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 336/670] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Aug 29 14:18:26 2021] GET /identity/v3/services => generated 772 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:26.952004 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fcc59-5f64-47a9-8f5d-054faeb9f9ce None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.952959 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fcc59-5f64-47a9-8f5d-054faeb9f9ce None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.953443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fcc59-5f64-47a9-8f5d-054faeb9f9ce None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.955953 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 335/671] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:26.962671 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fe408-ea7d-4470-a4c2-f26571d317af None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.962958 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fe408-ea7d-4470-a4c2-f26571d317af None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.963234 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fe408-ea7d-4470-a4c2-f26571d317af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.979916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e21c8-5e7b-4a18-b864-5cb265638a6c None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.980543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e21c8-5e7b-4a18-b864-5cb265638a6c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.980860 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e21c8-5e7b-4a18-b864-5cb265638a6c None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.984488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 336/672] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:26.984890 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-832fe408-ea7d-4470-a4c2-f26571d317af None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:26.986183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-832fe408-ea7d-4470-a4c2-f26571d317af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:26.992686 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68625d06-e1ea-447d-b834-5e18a9630d2e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:26.992973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68625d06-e1ea-447d-b834-5e18a9630d2e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:26.993252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68625d06-e1ea-447d-b834-5e18a9630d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:26.998381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 337/673] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:26 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:27.013712 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-68625d06-e1ea-447d-b834-5e18a9630d2e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:27.014928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-68625d06-e1ea-447d-b834-5e18a9630d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:27.023745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 337/674] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:26 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:27.033247 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fe408-ea7d-4470-a4c2-f26571d317af None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.047097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fe408-ea7d-4470-a4c2-f26571d317af None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.048425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68625d06-e1ea-447d-b834-5e18a9630d2e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.057983 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bf3ff-299e-4aa7-8314-9e6e7a87fe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.058596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68625d06-e1ea-447d-b834-5e18a9630d2e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.058794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bf3ff-299e-4aa7-8314-9e6e7a87fe2f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.059116 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bf3ff-299e-4aa7-8314-9e6e7a87fe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.059394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bf3ff-299e-4aa7-8314-9e6e7a87fe2f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.064096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac86874-60a7-4a93-be95-8da58c264cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.065386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac86874-60a7-4a93-be95-8da58c264cdb admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.065851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac86874-60a7-4a93-be95-8da58c264cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.066305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac86874-60a7-4a93-be95-8da58c264cdb admin admin] PATH_INFO: `/v3/services/network` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.067197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac86874-60a7-4a93-be95-8da58c264cdb admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.068946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac86874-60a7-4a93-be95-8da58c264cdb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.082190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-bac86874-60a7-4a93-be95-8da58c264cdb admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 14:18:27.083955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 338/675] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/services/network => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:27.090290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bf3ff-299e-4aa7-8314-9e6e7a87fe2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:27.090833 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac86874-60a7-4a93-be95-8da58c264cdb admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.103281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac86874-60a7-4a93-be95-8da58c264cdb admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.105782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-fe6bf3ff-299e-4aa7-8314-9e6e7a87fe2f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:18:27.107321 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 338/676] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:27.108947 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a86f0-427b-416b-b501-d9299996e4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.109819 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a86f0-427b-416b-b501-d9299996e4db admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.110268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a86f0-427b-416b-b501-d9299996e4db admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.110735 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a86f0-427b-416b-b501-d9299996e4db admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.111593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a86f0-427b-416b-b501-d9299996e4db admin admin] RBAC: Adding query filter params (name=network) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:27.112101 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a86f0-427b-416b-b501-d9299996e4db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.114393 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a86f0-427b-416b-b501-d9299996e4db admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.114694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bf3ff-299e-4aa7-8314-9e6e7a87fe2f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.120033 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 339/677] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/services?name=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:27.126972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a86f0-427b-416b-b501-d9299996e4db admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.133431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bf3ff-299e-4aa7-8314-9e6e7a87fe2f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.138407 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a86f0-427b-416b-b501-d9299996e4db admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.144459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92067d-15e1-4b0c-8e4a-0435450eae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.145794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92067d-15e1-4b0c-8e4a-0435450eae11 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.147209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92067d-15e1-4b0c-8e4a-0435450eae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.147977 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c21bf-7839-4940-bb71-5abc0a6e6ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.148801 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92067d-15e1-4b0c-8e4a-0435450eae11 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.149320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c21bf-7839-4940-bb71-5abc0a6e6ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.150331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92067d-15e1-4b0c-8e4a-0435450eae11 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:27.150802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c21bf-7839-4940-bb71-5abc0a6e6ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.151244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c21bf-7839-4940-bb71-5abc0a6e6ec4 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.152078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c21bf-7839-4940-bb71-5abc0a6e6ec4 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:27.152632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92067d-15e1-4b0c-8e4a-0435450eae11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.154490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92067d-15e1-4b0c-8e4a-0435450eae11 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.155094 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c21bf-7839-4940-bb71-5abc0a6e6ec4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.156860 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c21bf-7839-4940-bb71-5abc0a6e6ec4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.167487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 340/678] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/services?type=network => generated 350 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:27.173993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 339/679] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:27.183176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c21bf-7839-4940-bb71-5abc0a6e6ec4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.187004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92067d-15e1-4b0c-8e4a-0435450eae11 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.195275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c21bf-7839-4940-bb71-5abc0a6e6ec4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.209570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab6991-fbd8-4487-9b65-f769e37f289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.210630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab6991-fbd8-4487-9b65-f769e37f289d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.211127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab6991-fbd8-4487-9b65-f769e37f289d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.211551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab6991-fbd8-4487-9b65-f769e37f289d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.212571 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92067d-15e1-4b0c-8e4a-0435450eae11 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.224517 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed3591-f19c-4eb0-bfa1-c5cef7bae8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.225456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed3591-f19c-4eb0-bfa1-c5cef7bae8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.225919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed3591-f19c-4eb0-bfa1-c5cef7bae8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.227365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed3591-f19c-4eb0-bfa1-c5cef7bae8a0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.228377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed3591-f19c-4eb0-bfa1-c5cef7bae8a0 admin admin] RBAC: Adding query filter params (interface=public, service_id=8c72b41636084e8daab8d2e75fa51a07, region_id=RegionOne) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:27.229490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed3591-f19c-4eb0-bfa1-c5cef7bae8a0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.231505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-b4ed3591-f19c-4eb0-bfa1-c5cef7bae8a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:27.231505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:18:27.231505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:18:27.234395 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed3591-f19c-4eb0-bfa1-c5cef7bae8a0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.235600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab6991-fbd8-4487-9b65-f769e37f289d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.241599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab6991-fbd8-4487-9b65-f769e37f289d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.250222 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 340/680] 10.222.0.16 () {56 vars in 1273 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/endpoints?service_id=8c72b41636084e8daab8d2e75fa51a07&interface=public®ion_id=RegionOne => generated 194 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:27.260363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed3591-f19c-4eb0-bfa1-c5cef7bae8a0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.274230 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed3591-f19c-4eb0-bfa1-c5cef7bae8a0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.277548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-baab6991-fbd8-4487-9b65-f769e37f289d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:27.279774 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 341/681] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:27.283471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fcfae-0aa1-4a35-bbaf-bc6e2c4283e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.284323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fcfae-0aa1-4a35-bbaf-bc6e2c4283e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.284901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fcfae-0aa1-4a35-bbaf-bc6e2c4283e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.285585 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fcfae-0aa1-4a35-bbaf-bc6e2c4283e8 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.286588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab6991-fbd8-4487-9b65-f769e37f289d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.290056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fcfae-0aa1-4a35-bbaf-bc6e2c4283e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.294558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fcfae-0aa1-4a35-bbaf-bc6e2c4283e8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.303401 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 341/682] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/services => generated 772 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:27.306295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab6991-fbd8-4487-9b65-f769e37f289d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.319034 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a1b75-0d03-4ca7-9e1b-4389b5d0f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.320188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1b75-0d03-4ca7-9e1b-4389b5d0f43e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.320668 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1b75-0d03-4ca7-9e1b-4389b5d0f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.321140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1b75-0d03-4ca7-9e1b-4389b5d0f43e admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.322471 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1b75-0d03-4ca7-9e1b-4389b5d0f43e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:27.323003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1b75-0d03-4ca7-9e1b-4389b5d0f43e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.330061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1b75-0d03-4ca7-9e1b-4389b5d0f43e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.360126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 342/683] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:27.366301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fcfae-0aa1-4a35-bbaf-bc6e2c4283e8 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.390999 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fcfae-0aa1-4a35-bbaf-bc6e2c4283e8 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.400091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b4013-2158-4e9f-852f-9743edd49053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.401216 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b4013-2158-4e9f-852f-9743edd49053 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.401642 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b4013-2158-4e9f-852f-9743edd49053 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.404174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b4013-2158-4e9f-852f-9743edd49053 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.418968 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b4013-2158-4e9f-852f-9743edd49053 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.421290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b4013-2158-4e9f-852f-9743edd49053 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.440528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-671b4013-2158-4e9f-852f-9743edd49053 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 14:18:27.443023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 342/684] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:27.454001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a1b75-0d03-4ca7-9e1b-4389b5d0f43e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.472827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a1b75-0d03-4ca7-9e1b-4389b5d0f43e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.486824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace1d03-7c68-487d-8bf0-a7e1f90093bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.487525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace1d03-7c68-487d-8bf0-a7e1f90093bd admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.487858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace1d03-7c68-487d-8bf0-a7e1f90093bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.488127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace1d03-7c68-487d-8bf0-a7e1f90093bd admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.488977 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace1d03-7c68-487d-8bf0-a7e1f90093bd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:27.489282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace1d03-7c68-487d-8bf0-a7e1f90093bd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.491184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace1d03-7c68-487d-8bf0-a7e1f90093bd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.517686 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 343/685] 10.222.0.16 () {56 vars in 1155 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:27.525512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b4013-2158-4e9f-852f-9743edd49053 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.536336 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b4013-2158-4e9f-852f-9743edd49053 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.545377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fadee-9c82-4945-9dea-69a56c879236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.546063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fadee-9c82-4945-9dea-69a56c879236 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.546342 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fadee-9c82-4945-9dea-69a56c879236 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.546611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fadee-9c82-4945-9dea-69a56c879236 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.557181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fadee-9c82-4945-9dea-69a56c879236 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.559005 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fadee-9c82-4945-9dea-69a56c879236 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.571325 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 343/686] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:27.577409 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace1d03-7c68-487d-8bf0-a7e1f90093bd admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.588854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace1d03-7c68-487d-8bf0-a7e1f90093bd admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.594846 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65c6fb-c422-4cb1-8244-d296c549bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.595642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65c6fb-c422-4cb1-8244-d296c549bca9 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.595920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65c6fb-c422-4cb1-8244-d296c549bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.596190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65c6fb-c422-4cb1-8244-d296c549bca9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.610076 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65c6fb-c422-4cb1-8244-d296c549bca9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.611925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65c6fb-c422-4cb1-8244-d296c549bca9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.632302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-ab65c6fb-c422-4cb1-8244-d296c549bca9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:27.634118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 344/687] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:27.640070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fadee-9c82-4945-9dea-69a56c879236 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.650584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fadee-9c82-4945-9dea-69a56c879236 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.657996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ec2d5-81fc-40b4-a3b3-8cc4c6977f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.658672 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec2d5-81fc-40b4-a3b3-8cc4c6977f93 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.658945 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec2d5-81fc-40b4-a3b3-8cc4c6977f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.659216 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec2d5-81fc-40b4-a3b3-8cc4c6977f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.660515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ec2d5-81fc-40b4-a3b3-8cc4c6977f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:27.660814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ec2d5-81fc-40b4-a3b3-8cc4c6977f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.662506 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ec2d5-81fc-40b4-a3b3-8cc4c6977f93 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.689618 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 344/688] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:27.695948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65c6fb-c422-4cb1-8244-d296c549bca9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.711614 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65c6fb-c422-4cb1-8244-d296c549bca9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.720348 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f00ede-0743-464b-afb6-40c39ad8a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.721143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f00ede-0743-464b-afb6-40c39ad8a08e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.721420 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f00ede-0743-464b-afb6-40c39ad8a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.721690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f00ede-0743-464b-afb6-40c39ad8a08e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.735413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f00ede-0743-464b-afb6-40c39ad8a08e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.737310 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f00ede-0743-464b-afb6-40c39ad8a08e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.752109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-13f00ede-0743-464b-afb6-40c39ad8a08e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:27.754719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb18b66-5874-4a78-be45-ebe618e7c06c None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.754998 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb18b66-5874-4a78-be45-ebe618e7c06c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.755266 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb18b66-5874-4a78-be45-ebe618e7c06c None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.757129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 345/689] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:27.757566 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 345/690] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:27.763175 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938fcce-bdc8-4fce-ab42-06640d880d86 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.763451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938fcce-bdc8-4fce-ab42-06640d880d86 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.763629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f00ede-0743-464b-afb6-40c39ad8a08e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.763802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938fcce-bdc8-4fce-ab42-06640d880d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.776063 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f00ede-0743-464b-afb6-40c39ad8a08e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.780911 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb88df-b171-4832-8b58-544f7621145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.781610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb88df-b171-4832-8b58-544f7621145c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.781922 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb88df-b171-4832-8b58-544f7621145c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.782201 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb88df-b171-4832-8b58-544f7621145c admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.783073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb88df-b171-4832-8b58-544f7621145c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:27.783376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb88df-b171-4832-8b58-544f7621145c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.785894 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb88df-b171-4832-8b58-544f7621145c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.791547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-8938fcce-bdc8-4fce-ab42-06640d880d86 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:27.792742 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8938fcce-bdc8-4fce-ab42-06640d880d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:27.798795 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 346/691] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:27.804942 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb88df-b171-4832-8b58-544f7621145c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.821986 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 346/692] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:27 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:27.824967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb88df-b171-4832-8b58-544f7621145c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.829771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce7ee1-3930-4e7d-a8df-383b71929822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.830570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce7ee1-3930-4e7d-a8df-383b71929822 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.830916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce7ee1-3930-4e7d-a8df-383b71929822 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.831813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce7ee1-3930-4e7d-a8df-383b71929822 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.832992 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce7ee1-3930-4e7d-a8df-383b71929822 admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=d8c0afa8f09f4923b9c8ab2696156129) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:27.833398 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce7ee1-3930-4e7d-a8df-383b71929822 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.835636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce7ee1-3930-4e7d-a8df-383b71929822 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.842511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 347/693] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/role_assignments?user.id=d8c0afa8f09f4923b9c8ab2696156129&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:27.856708 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938fcce-bdc8-4fce-ab42-06640d880d86 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.868506 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938fcce-bdc8-4fce-ab42-06640d880d86 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.876350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe7278-ec8b-42b6-987d-4dd43f2b7dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.877289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe7278-ec8b-42b6-987d-4dd43f2b7dbb admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.877684 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe7278-ec8b-42b6-987d-4dd43f2b7dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.878079 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe7278-ec8b-42b6-987d-4dd43f2b7dbb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.892654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe7278-ec8b-42b6-987d-4dd43f2b7dbb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:27.900935 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-bdfe7278-ec8b-42b6-987d-4dd43f2b7dbb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:27.902661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 347/694] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:27.909337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce7ee1-3930-4e7d-a8df-383b71929822 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.923097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce7ee1-3930-4e7d-a8df-383b71929822 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.930295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1819888-9654-4f3e-a2fd-e1b9b83abe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.931137 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1819888-9654-4f3e-a2fd-e1b9b83abe73 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.931482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1819888-9654-4f3e-a2fd-e1b9b83abe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.931819 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1819888-9654-4f3e-a2fd-e1b9b83abe73 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.932702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1819888-9654-4f3e-a2fd-e1b9b83abe73 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:27.933071 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1819888-9654-4f3e-a2fd-e1b9b83abe73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:27.934949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1819888-9654-4f3e-a2fd-e1b9b83abe73 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:27.950167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 348/695] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:27.957631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe7278-ec8b-42b6-987d-4dd43f2b7dbb admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:27.971306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe7278-ec8b-42b6-987d-4dd43f2b7dbb admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:27.978659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b5a83-5ef4-4fe0-a0f0-de9873f85429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:27.979610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b5a83-5ef4-4fe0-a0f0-de9873f85429 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:27.979955 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b5a83-5ef4-4fe0-a0f0-de9873f85429 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:27.980423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b5a83-5ef4-4fe0-a0f0-de9873f85429 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:27.998906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b5a83-5ef4-4fe0-a0f0-de9873f85429 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:28.001071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b5a83-5ef4-4fe0-a0f0-de9873f85429 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:28.021781 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-cd5b5a83-5ef4-4fe0-a0f0-de9873f85429 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:28.023471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 348/696] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:28.035760 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1819888-9654-4f3e-a2fd-e1b9b83abe73 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:28.048021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1819888-9654-4f3e-a2fd-e1b9b83abe73 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:28.060318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81138fe7-18a0-4257-8f0a-a3996cd3cfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:28.060318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81138fe7-18a0-4257-8f0a-a3996cd3cfed admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:28.060318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81138fe7-18a0-4257-8f0a-a3996cd3cfed admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:28.060318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81138fe7-18a0-4257-8f0a-a3996cd3cfed admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:28.060660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81138fe7-18a0-4257-8f0a-a3996cd3cfed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:28.060660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81138fe7-18a0-4257-8f0a-a3996cd3cfed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:28.060660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81138fe7-18a0-4257-8f0a-a3996cd3cfed admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:28.074911 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 349/697] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:28.082095 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b5a83-5ef4-4fe0-a0f0-de9873f85429 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:28.094951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b5a83-5ef4-4fe0-a0f0-de9873f85429 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:28.099858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d91ac-26a5-40fb-ae53-1688f67b601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:28.100659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d91ac-26a5-40fb-ae53-1688f67b601b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:28.101000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d91ac-26a5-40fb-ae53-1688f67b601b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:28.101273 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d91ac-26a5-40fb-ae53-1688f67b601b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:28.112172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d91ac-26a5-40fb-ae53-1688f67b601b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:28.114330 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d91ac-26a5-40fb-ae53-1688f67b601b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:28.129021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-2f3d91ac-26a5-40fb-ae53-1688f67b601b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 14:18:28.130617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 349/698] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Aug 29 14:18:28 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:28.137235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81138fe7-18a0-4257-8f0a-a3996cd3cfed admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:28.148103 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81138fe7-18a0-4257-8f0a-a3996cd3cfed admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:28.153724 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d8f88-89e7-45ee-9792-96122cddab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:28.154429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d8f88-89e7-45ee-9792-96122cddab66 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:28.154712 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d8f88-89e7-45ee-9792-96122cddab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:28.154984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d8f88-89e7-45ee-9792-96122cddab66 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:28.155818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d8f88-89e7-45ee-9792-96122cddab66 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:28.156118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d8f88-89e7-45ee-9792-96122cddab66 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:28.157978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d8f88-89e7-45ee-9792-96122cddab66 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:28.177950 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 350/699] 10.222.0.16 () {56 vars in 1171 bytes} [Sun Aug 29 14:18:28 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:28.184088 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d91ac-26a5-40fb-ae53-1688f67b601b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:28.194131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d91ac-26a5-40fb-ae53-1688f67b601b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:28.198631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a2796-e32d-4921-a432-6d48d8901d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:28.199415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a2796-e32d-4921-a432-6d48d8901d27 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:28.199696 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a2796-e32d-4921-a432-6d48d8901d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:28.199969 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a2796-e32d-4921-a432-6d48d8901d27 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:28.211306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a2796-e32d-4921-a432-6d48d8901d27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:28.213133 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a2796-e32d-4921-a432-6d48d8901d27 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:28.230643 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-ab2a2796-e32d-4921-a432-6d48d8901d27 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:28.232160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 350/700] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:28.239064 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d8f88-89e7-45ee-9792-96122cddab66 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:28.249079 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d8f88-89e7-45ee-9792-96122cddab66 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:28.253703 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeed0c8-70f2-47f8-924e-c1ec9f103c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:28.254424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeed0c8-70f2-47f8-924e-c1ec9f103c96 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:28.254707 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeed0c8-70f2-47f8-924e-c1ec9f103c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:28.254978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeed0c8-70f2-47f8-924e-c1ec9f103c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:28.255696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeed0c8-70f2-47f8-924e-c1ec9f103c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:28.255997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeed0c8-70f2-47f8-924e-c1ec9f103c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:28.257593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeed0c8-70f2-47f8-924e-c1ec9f103c96 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:28.270483 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 351/701] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:28.276538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a2796-e32d-4921-a432-6d48d8901d27 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:28.286575 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a2796-e32d-4921-a432-6d48d8901d27 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:28.291087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daa4d0-fb69-414d-b4dd-843912794e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:28.291929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daa4d0-fb69-414d-b4dd-843912794e3b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:28.292211 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daa4d0-fb69-414d-b4dd-843912794e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:28.292547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daa4d0-fb69-414d-b4dd-843912794e3b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:28.299733 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7daa4d0-fb69-414d-b4dd-843912794e3b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:28.302470 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7daa4d0-fb69-414d-b4dd-843912794e3b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:28.316212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-a7daa4d0-fb69-414d-b4dd-843912794e3b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:28.317682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 351/702] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:28.323975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeed0c8-70f2-47f8-924e-c1ec9f103c96 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:28.335014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeed0c8-70f2-47f8-924e-c1ec9f103c96 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:28.339935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cecfdd-9a57-4fb0-9be7-aa8ed61b5433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:28.340627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cecfdd-9a57-4fb0-9be7-aa8ed61b5433 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:28.340963 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cecfdd-9a57-4fb0-9be7-aa8ed61b5433 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:28.341243 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cecfdd-9a57-4fb0-9be7-aa8ed61b5433 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:28.342096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cecfdd-9a57-4fb0-9be7-aa8ed61b5433 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:28.342408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cecfdd-9a57-4fb0-9be7-aa8ed61b5433 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:28.344341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cecfdd-9a57-4fb0-9be7-aa8ed61b5433 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:28.359048 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 352/703] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:28.365411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daa4d0-fb69-414d-b4dd-843912794e3b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:28.375425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daa4d0-fb69-414d-b4dd-843912794e3b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:28.380975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab1e84-b01d-4c18-97aa-678d475e686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:28.381940 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab1e84-b01d-4c18-97aa-678d475e686a admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:28.382281 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab1e84-b01d-4c18-97aa-678d475e686a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:28.382561 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab1e84-b01d-4c18-97aa-678d475e686a admin admin] PATH_INFO: `/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/afee50dd81e5484081d4aef1c119a129/roles/ac37a5f3e1454b8f929c2419c3e148cb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:28.398970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab1e84-b01d-4c18-97aa-678d475e686a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c728e9160de45afbd4902c27eef45b3, user_id=afee50dd81e5484081d4aef1c119a129, role_id=ac37a5f3e1454b8f929c2419c3e148cb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:28.401698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab1e84-b01d-4c18-97aa-678d475e686a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:28.491434 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 352/704] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:18:28 2021] PUT /identity/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/afee50dd81e5484081d4aef1c119a129/roles/ac37a5f3e1454b8f929c2419c3e148cb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:18:29.371244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af41816-757a-4f18-9257-40208b8a8588 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.371971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af41816-757a-4f18-9257-40208b8a8588 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.371971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af41816-757a-4f18-9257-40208b8a8588 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.374276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 353/705] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:29.382480 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cd2c0-7593-4c5a-9e7b-1c8f03498003 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.383021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cd2c0-7593-4c5a-9e7b-1c8f03498003 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.383021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cd2c0-7593-4c5a-9e7b-1c8f03498003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.411109 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-926cd2c0-7593-4c5a-9e7b-1c8f03498003 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:29.412307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-926cd2c0-7593-4c5a-9e7b-1c8f03498003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:29.484406 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 353/706] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:29 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:29.529570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af41816-757a-4f18-9257-40208b8a8588 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:29.548128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af41816-757a-4f18-9257-40208b8a8588 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:29.555970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a7fe9-177b-4ec4-9408-2248e204da98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:29.556773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a7fe9-177b-4ec4-9408-2248e204da98 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.557049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a7fe9-177b-4ec4-9408-2248e204da98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.557322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a7fe9-177b-4ec4-9408-2248e204da98 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.557990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a7fe9-177b-4ec4-9408-2248e204da98 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:29.559581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a7fe9-177b-4ec4-9408-2248e204da98 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:29.575582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-3c6a7fe9-177b-4ec4-9408-2248e204da98 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 14:18:29.577069 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 354/707] 10.222.0.16 () {56 vars in 1151 bytes} [Sun Aug 29 14:18:29 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:29.583929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cd2c0-7593-4c5a-9e7b-1c8f03498003 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:29.592985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cd2c0-7593-4c5a-9e7b-1c8f03498003 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:29.599161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb254f7d-94ac-403e-ab4c-1cdae01d1278 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.599454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb254f7d-94ac-403e-ab4c-1cdae01d1278 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.599731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb254f7d-94ac-403e-ab4c-1cdae01d1278 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.602586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 355/708] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:29.605013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fae74-e70f-4a4b-9773-dcdd02235410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:29.605745 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fae74-e70f-4a4b-9773-dcdd02235410 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.606072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fae74-e70f-4a4b-9773-dcdd02235410 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.606344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fae74-e70f-4a4b-9773-dcdd02235410 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.607050 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fae74-e70f-4a4b-9773-dcdd02235410 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:29.607352 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fae74-e70f-4a4b-9773-dcdd02235410 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:29.609897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fae74-e70f-4a4b-9773-dcdd02235410 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:29.610098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fbd5a-701e-45eb-94b5-a6cbb1084d43 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.610098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fbd5a-701e-45eb-94b5-a6cbb1084d43 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.610599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fbd5a-701e-45eb-94b5-a6cbb1084d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.619535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 354/709] 10.222.0.16 () {56 vars in 1146 bytes} [Sun Aug 29 14:18:29 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:29.629961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fae74-e70f-4a4b-9773-dcdd02235410 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:29.644478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fae74-e70f-4a4b-9773-dcdd02235410 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:29.645403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-1c2fbd5a-701e-45eb-94b5-a6cbb1084d43 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:29.648544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1c2fbd5a-701e-45eb-94b5-a6cbb1084d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:29.655195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2740d99-1dc9-4f54-8d0e-f7e54766f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:29.655863 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2740d99-1dc9-4f54-8d0e-f7e54766f9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.656136 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2740d99-1dc9-4f54-8d0e-f7e54766f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.656405 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2740d99-1dc9-4f54-8d0e-f7e54766f9d4 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.657106 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2740d99-1dc9-4f54-8d0e-f7e54766f9d4 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:29.657405 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2740d99-1dc9-4f54-8d0e-f7e54766f9d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:29.658997 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2740d99-1dc9-4f54-8d0e-f7e54766f9d4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:29.663577 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 356/710] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:29 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:29.673113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 355/711] 10.222.0.16 () {56 vars in 1146 bytes} [Sun Aug 29 14:18:29 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:29.679352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fbd5a-701e-45eb-94b5-a6cbb1084d43 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:29.695567 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fbd5a-701e-45eb-94b5-a6cbb1084d43 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:29.697460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2740d99-1dc9-4f54-8d0e-f7e54766f9d4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:29.709127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3a84a-f17d-417b-86b1-18b1d6f5354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:29.709626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2740d99-1dc9-4f54-8d0e-f7e54766f9d4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:29.709797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3a84a-f17d-417b-86b1-18b1d6f5354b admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.710096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3a84a-f17d-417b-86b1-18b1d6f5354b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.710465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3a84a-f17d-417b-86b1-18b1d6f5354b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.711316 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3a84a-f17d-417b-86b1-18b1d6f5354b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:29.712336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-39c3a84a-f17d-417b-86b1-18b1d6f5354b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:29.712336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:18:29.712336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:18:29.716810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3a84a-f17d-417b-86b1-18b1d6f5354b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:29.721323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcf271-6f03-4dc6-8ef6-a9be4d3d9b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:29.722738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcf271-6f03-4dc6-8ef6-a9be4d3d9b62 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.723055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcf271-6f03-4dc6-8ef6-a9be4d3d9b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.723376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcf271-6f03-4dc6-8ef6-a9be4d3d9b62 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.744953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcf271-6f03-4dc6-8ef6-a9be4d3d9b62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:29.752297 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-b3bcf271-6f03-4dc6-8ef6-a9be4d3d9b62 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:18:29.754491 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 356/712] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:29.761204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcf271-6f03-4dc6-8ef6-a9be4d3d9b62 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:29.772602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcf271-6f03-4dc6-8ef6-a9be4d3d9b62 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:29.777191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e15b8-7b90-4701-bbc1-bef4db5f70f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:29.777923 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e15b8-7b90-4701-bbc1-bef4db5f70f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.778208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e15b8-7b90-4701-bbc1-bef4db5f70f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.778484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e15b8-7b90-4701-bbc1-bef4db5f70f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.779279 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e15b8-7b90-4701-bbc1-bef4db5f70f0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:29.779583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e15b8-7b90-4701-bbc1-bef4db5f70f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:29.781216 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e15b8-7b90-4701-bbc1-bef4db5f70f0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:29.790845 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 357/713] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:29.796895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e15b8-7b90-4701-bbc1-bef4db5f70f0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:29.807628 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e15b8-7b90-4701-bbc1-bef4db5f70f0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:29.817590 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 357/714] 10.222.0.16 () {60 vars in 1166 bytes} [Sun Aug 29 14:18:29 2021] POST /identity/v3/endpoints => generated 346 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:18:29.832204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309759c1-40b8-4f1f-9f7d-e517be90ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:29.833074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309759c1-40b8-4f1f-9f7d-e517be90ee7d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.833396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309759c1-40b8-4f1f-9f7d-e517be90ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.833682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309759c1-40b8-4f1f-9f7d-e517be90ee7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.846029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309759c1-40b8-4f1f-9f7d-e517be90ee7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:29.848021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309759c1-40b8-4f1f-9f7d-e517be90ee7d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:29.867872 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-309759c1-40b8-4f1f-9f7d-e517be90ee7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:29.869522 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 358/715] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:29.876269 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3a84a-f17d-417b-86b1-18b1d6f5354b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:29.888194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3a84a-f17d-417b-86b1-18b1d6f5354b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:29.893057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2c963-8b5e-455e-97ef-96ac786fc1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:29.893791 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2c963-8b5e-455e-97ef-96ac786fc1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.894255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2c963-8b5e-455e-97ef-96ac786fc1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.894715 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2c963-8b5e-455e-97ef-96ac786fc1a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.895523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2c963-8b5e-455e-97ef-96ac786fc1a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:29.895874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2c963-8b5e-455e-97ef-96ac786fc1a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:29.897575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2c963-8b5e-455e-97ef-96ac786fc1a4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:29.911145 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 358/716] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:29.917418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309759c1-40b8-4f1f-9f7d-e517be90ee7d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:29.928467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309759c1-40b8-4f1f-9f7d-e517be90ee7d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:29.946236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c97e0-0fe5-4bc3-9b40-1fd596609e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:29.947137 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c97e0-0fe5-4bc3-9b40-1fd596609e7f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.947422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c97e0-0fe5-4bc3-9b40-1fd596609e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.947698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c97e0-0fe5-4bc3-9b40-1fd596609e7f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.956458 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c97e0-0fe5-4bc3-9b40-1fd596609e7f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:29.958791 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c97e0-0fe5-4bc3-9b40-1fd596609e7f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:29.980632 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf6864-090e-4b6e-b7ac-19159785ae53 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.980957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf6864-090e-4b6e-b7ac-19159785ae53 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.981177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf6864-090e-4b6e-b7ac-19159785ae53 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:29.981748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-4d2c97e0-0fe5-4bc3-9b40-1fd596609e7f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 14:18:29.983236 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 359/717] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:29.983409 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 359/718] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:29 2021] GET /identity/v3/users/swift => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:29.990147 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c97e0-0fe5-4bc3-9b40-1fd596609e7f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:29.990497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd04cfc-a29d-45bc-b180-5d4af70f2f2c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:29.990789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd04cfc-a29d-45bc-b180-5d4af70f2f2c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:29.991066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd04cfc-a29d-45bc-b180-5d4af70f2f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.009477 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c97e0-0fe5-4bc3-9b40-1fd596609e7f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:30.021110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fc87e-ea82-4e2c-8b59-854c3afa78a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:30.021842 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fc87e-ea82-4e2c-8b59-854c3afa78a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:30.022152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fc87e-ea82-4e2c-8b59-854c3afa78a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:30.022423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fc87e-ea82-4e2c-8b59-854c3afa78a9 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.023369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fc87e-ea82-4e2c-8b59-854c3afa78a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:30.023677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fc87e-ea82-4e2c-8b59-854c3afa78a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:30.025722 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-cbd04cfc-a29d-45bc-b180-5d4af70f2f2c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:30.027479 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fc87e-ea82-4e2c-8b59-854c3afa78a9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:30.029320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-cbd04cfc-a29d-45bc-b180-5d4af70f2f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:30.048114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 360/719] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:29 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:30.058444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 360/720] 10.222.0.16 () {56 vars in 1157 bytes} [Sun Aug 29 14:18:29 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:30.067094 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd04cfc-a29d-45bc-b180-5d4af70f2f2c None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:30.075702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fc87e-ea82-4e2c-8b59-854c3afa78a9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:30.078414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd04cfc-a29d-45bc-b180-5d4af70f2f2c None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:30.086000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fc87e-ea82-4e2c-8b59-854c3afa78a9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:30.090721 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620fb66-0c52-491d-8073-00961adad217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:30.091525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620fb66-0c52-491d-8073-00961adad217 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:30.091806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620fb66-0c52-491d-8073-00961adad217 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:30.092075 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620fb66-0c52-491d-8073-00961adad217 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.092732 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620fb66-0c52-491d-8073-00961adad217 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:30.092959 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915285f-6e92-41bf-9ecb-2fbacd09d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:30.094024 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915285f-6e92-41bf-9ecb-2fbacd09d74f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:30.094361 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620fb66-0c52-491d-8073-00961adad217 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:30.094730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915285f-6e92-41bf-9ecb-2fbacd09d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:30.095097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915285f-6e92-41bf-9ecb-2fbacd09d74f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.106774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-7620fb66-0c52-491d-8073-00961adad217 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 14:18:30.108522 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 361/721] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:30 2021] GET /identity/v3/services/network => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:30.117797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915285f-6e92-41bf-9ecb-2fbacd09d74f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:30.119698 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915285f-6e92-41bf-9ecb-2fbacd09d74f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:30.121837 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620fb66-0c52-491d-8073-00961adad217 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:30.134591 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620fb66-0c52-491d-8073-00961adad217 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:30.139764 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caeec27-059f-445c-9338-ceabf8ebc495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:30.140681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caeec27-059f-445c-9338-ceabf8ebc495 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:30.141205 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caeec27-059f-445c-9338-ceabf8ebc495 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:30.141674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caeec27-059f-445c-9338-ceabf8ebc495 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.142481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-c915285f-6e92-41bf-9ecb-2fbacd09d74f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:30.142827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caeec27-059f-445c-9338-ceabf8ebc495 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:30.143363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caeec27-059f-445c-9338-ceabf8ebc495 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:30.144119 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 361/722] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:30.145465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caeec27-059f-445c-9338-ceabf8ebc495 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:30.157943 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 362/723] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:30 2021] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:30.158467 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915285f-6e92-41bf-9ecb-2fbacd09d74f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:30.161316 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caeec27-059f-445c-9338-ceabf8ebc495 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:30.171399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915285f-6e92-41bf-9ecb-2fbacd09d74f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:30.172483 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caeec27-059f-445c-9338-ceabf8ebc495 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:30.177503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f58388-8fc1-4c3a-a2c9-a231102b9869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:30.178495 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f58388-8fc1-4c3a-a2c9-a231102b9869 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:30.178730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345c0ae-4657-4585-9baf-13a17687f883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:30.179180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f58388-8fc1-4c3a-a2c9-a231102b9869 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:30.179581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345c0ae-4657-4585-9baf-13a17687f883 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:30.179808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f58388-8fc1-4c3a-a2c9-a231102b9869 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.179953 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345c0ae-4657-4585-9baf-13a17687f883 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:30.180336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345c0ae-4657-4585-9baf-13a17687f883 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.181013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f58388-8fc1-4c3a-a2c9-a231102b9869 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:30.181115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345c0ae-4657-4585-9baf-13a17687f883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:30.181543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345c0ae-4657-4585-9baf-13a17687f883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:30.181772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f58388-8fc1-4c3a-a2c9-a231102b9869 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:30.183591 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345c0ae-4657-4585-9baf-13a17687f883 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:30.183776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f58388-8fc1-4c3a-a2c9-a231102b9869 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:30.191481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 363/724] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:30 2021] GET /identity/v3/services?type=network => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:30.199015 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f58388-8fc1-4c3a-a2c9-a231102b9869 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:30.204391 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 362/725] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:30.214033 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345c0ae-4657-4585-9baf-13a17687f883 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:30.215518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f58388-8fc1-4c3a-a2c9-a231102b9869 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:30.220663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69f61d-cedb-4e38-a1cf-fb872192d7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:30.221516 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69f61d-cedb-4e38-a1cf-fb872192d7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:30.222648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69f61d-cedb-4e38-a1cf-fb872192d7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:30.223089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69f61d-cedb-4e38-a1cf-fb872192d7f8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.224019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69f61d-cedb-4e38-a1cf-fb872192d7f8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:30.225174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-9b69f61d-cedb-4e38-a1cf-fb872192d7f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:18:30.225174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:18:30.225174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:18:30.226394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69f61d-cedb-4e38-a1cf-fb872192d7f8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:30.232496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345c0ae-4657-4585-9baf-13a17687f883 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:30.247169 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa2826-40e9-4fe3-8629-3fc90021b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:30.248480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa2826-40e9-4fe3-8629-3fc90021b374 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:30.248990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa2826-40e9-4fe3-8629-3fc90021b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:30.249440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa2826-40e9-4fe3-8629-3fc90021b374 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.257652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa2826-40e9-4fe3-8629-3fc90021b374 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:30.260268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa2826-40e9-4fe3-8629-3fc90021b374 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:30.274733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-eefa2826-40e9-4fe3-8629-3fc90021b374 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:30.276469 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 363/726] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:30.282773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa2826-40e9-4fe3-8629-3fc90021b374 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:30.295102 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa2826-40e9-4fe3-8629-3fc90021b374 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:30.301075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39171582-0b68-46d4-8672-c828605c0768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:30.302066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39171582-0b68-46d4-8672-c828605c0768 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:30.302571 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39171582-0b68-46d4-8672-c828605c0768 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:30.303036 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39171582-0b68-46d4-8672-c828605c0768 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.304037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39171582-0b68-46d4-8672-c828605c0768 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:30.304532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39171582-0b68-46d4-8672-c828605c0768 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:30.306599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39171582-0b68-46d4-8672-c828605c0768 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:30.319338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 364/727] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:30.325943 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39171582-0b68-46d4-8672-c828605c0768 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:30.341815 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 364/728] 10.222.0.16 () {60 vars in 1166 bytes} [Sun Aug 29 14:18:30 2021] POST /identity/v3/endpoints => generated 327 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:30.348371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39171582-0b68-46d4-8672-c828605c0768 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:30.365124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17663b-66de-4ae2-97b4-19c07173154d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:30.370627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17663b-66de-4ae2-97b4-19c07173154d admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:30.370929 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17663b-66de-4ae2-97b4-19c07173154d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:30.371189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17663b-66de-4ae2-97b4-19c07173154d admin admin] PATH_INFO: `/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/f37041a9727e4ab6a5c52b00327e7a19/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.379182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17663b-66de-4ae2-97b4-19c07173154d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c728e9160de45afbd4902c27eef45b3, user_id=f37041a9727e4ab6a5c52b00327e7a19, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:30.381925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17663b-66de-4ae2-97b4-19c07173154d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:30.456941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 365/729] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:18:30 2021] PUT /identity/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/f37041a9727e4ab6a5c52b00327e7a19/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:18:30.894633 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec5255-8bdd-4149-85b5-fccd310e2baa None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:30.895171 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec5255-8bdd-4149-85b5-fccd310e2baa None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:30.895171 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec5255-8bdd-4149-85b5-fccd310e2baa None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.897279 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 365/730] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:30.903526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35fae7-fe9b-4d17-9e2a-5f97610ece22 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:30.903815 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35fae7-fe9b-4d17-9e2a-5f97610ece22 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:30.904090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35fae7-fe9b-4d17-9e2a-5f97610ece22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:30.922391 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0b35fae7-fe9b-4d17-9e2a-5f97610ece22 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:30.923647 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0b35fae7-fe9b-4d17-9e2a-5f97610ece22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:30.982763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 366/731] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:30 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:31.007311 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec5255-8bdd-4149-85b5-fccd310e2baa None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.025367 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec5255-8bdd-4149-85b5-fccd310e2baa None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.032035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6547d83-d434-4a22-8987-75f4d26c376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.032035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6547d83-d434-4a22-8987-75f4d26c376e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.032035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6547d83-d434-4a22-8987-75f4d26c376e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.032035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6547d83-d434-4a22-8987-75f4d26c376e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.033135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6547d83-d434-4a22-8987-75f4d26c376e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.035368 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6547d83-d434-4a22-8987-75f4d26c376e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.047663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-a6547d83-d434-4a22-8987-75f4d26c376e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 14:18:31.049258 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 366/732] 10.222.0.16 () {56 vars in 1154 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:31.056576 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35fae7-fe9b-4d17-9e2a-5f97610ece22 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.066542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35fae7-fe9b-4d17-9e2a-5f97610ece22 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.071252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e58d0-0cb1-4ee4-b618-7a5f4ff9439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.071923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e58d0-0cb1-4ee4-b618-7a5f4ff9439f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.072200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e58d0-0cb1-4ee4-b618-7a5f4ff9439f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.072469 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e58d0-0cb1-4ee4-b618-7a5f4ff9439f admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.073176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e58d0-0cb1-4ee4-b618-7a5f4ff9439f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:31.073489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e58d0-0cb1-4ee4-b618-7a5f4ff9439f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.075110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e58d0-0cb1-4ee4-b618-7a5f4ff9439f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.080313 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 367/733] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:31.086599 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6547d83-d434-4a22-8987-75f4d26c376e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.097446 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6547d83-d434-4a22-8987-75f4d26c376e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.102016 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1ea5a-1eb4-4551-bbb6-da5b097cf5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.102646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1ea5a-1eb4-4551-bbb6-da5b097cf5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.102918 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1ea5a-1eb4-4551-bbb6-da5b097cf5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.103187 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1ea5a-1eb4-4551-bbb6-da5b097cf5e2 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.103879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1ea5a-1eb4-4551-bbb6-da5b097cf5e2 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:31.104173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1ea5a-1eb4-4551-bbb6-da5b097cf5e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.105738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1ea5a-1eb4-4551-bbb6-da5b097cf5e2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.110659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 367/734] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:31.130399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab370f-11cb-478f-bd43-ba73c09140a7 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.130728 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab370f-11cb-478f-bd43-ba73c09140a7 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.130957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab370f-11cb-478f-bd43-ba73c09140a7 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.133086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 368/735] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:31.140020 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7387b-8531-428a-86cc-a32694e566aa None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.140352 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7387b-8531-428a-86cc-a32694e566aa None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.140572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7387b-8531-428a-86cc-a32694e566aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.160549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-6bb7387b-8531-428a-86cc-a32694e566aa None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:31.161679 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-6bb7387b-8531-428a-86cc-a32694e566aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:31.170075 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 368/736] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:31 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:31.195012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab370f-11cb-478f-bd43-ba73c09140a7 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.207913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab370f-11cb-478f-bd43-ba73c09140a7 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.215031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb51dd-8a04-4de6-b519-83e6be988f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.216250 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb51dd-8a04-4de6-b519-83e6be988f75 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.216706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb51dd-8a04-4de6-b519-83e6be988f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.217149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb51dd-8a04-4de6-b519-83e6be988f75 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.230424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb51dd-8a04-4de6-b519-83e6be988f75 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:31.237477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-fdeb51dd-8a04-4de6-b519-83e6be988f75 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:18:31.239103 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 369/737] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:31.245672 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7387b-8531-428a-86cc-a32694e566aa None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.255682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7387b-8531-428a-86cc-a32694e566aa None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.260830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe6fdd-6b89-4f40-a1fe-471cf956c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.261532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe6fdd-6b89-4f40-a1fe-471cf956c463 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.261814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe6fdd-6b89-4f40-a1fe-471cf956c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.262129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe6fdd-6b89-4f40-a1fe-471cf956c463 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.262916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe6fdd-6b89-4f40-a1fe-471cf956c463 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:31.263223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe6fdd-6b89-4f40-a1fe-471cf956c463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.264955 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe6fdd-6b89-4f40-a1fe-471cf956c463 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.275498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 369/738] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:31.281708 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb51dd-8a04-4de6-b519-83e6be988f75 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.293446 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb51dd-8a04-4de6-b519-83e6be988f75 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.298743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66e550-56d8-42d0-88cf-e4e436a26817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.299650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66e550-56d8-42d0-88cf-e4e436a26817 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.300789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66e550-56d8-42d0-88cf-e4e436a26817 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.301067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66e550-56d8-42d0-88cf-e4e436a26817 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.311961 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66e550-56d8-42d0-88cf-e4e436a26817 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.313805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66e550-56d8-42d0-88cf-e4e436a26817 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.332884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-ef66e550-56d8-42d0-88cf-e4e436a26817 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:31.334440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 370/739] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:31.341514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe6fdd-6b89-4f40-a1fe-471cf956c463 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.350804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe6fdd-6b89-4f40-a1fe-471cf956c463 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.355738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334a6f8-3f5c-4d1e-9760-69c43a045ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.356661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334a6f8-3f5c-4d1e-9760-69c43a045ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.357157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334a6f8-3f5c-4d1e-9760-69c43a045ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.357629 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334a6f8-3f5c-4d1e-9760-69c43a045ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.358586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334a6f8-3f5c-4d1e-9760-69c43a045ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:31.359203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334a6f8-3f5c-4d1e-9760-69c43a045ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.361027 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334a6f8-3f5c-4d1e-9760-69c43a045ac2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.374252 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 370/740] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:31.381395 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66e550-56d8-42d0-88cf-e4e436a26817 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.392150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66e550-56d8-42d0-88cf-e4e436a26817 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.397103 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f9171-e28d-4144-bb7f-5efdab69c4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.398232 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f9171-e28d-4144-bb7f-5efdab69c4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.398713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f9171-e28d-4144-bb7f-5efdab69c4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.399267 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f9171-e28d-4144-bb7f-5efdab69c4a7 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.407215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f9171-e28d-4144-bb7f-5efdab69c4a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.409542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f9171-e28d-4144-bb7f-5efdab69c4a7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.424215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-e82f9171-e28d-4144-bb7f-5efdab69c4a7 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 14:18:31.426646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 371/741] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:31.433068 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334a6f8-3f5c-4d1e-9760-69c43a045ac2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.443981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334a6f8-3f5c-4d1e-9760-69c43a045ac2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.448814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1125b1-4748-42ba-93ff-cca4a4ff221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.449696 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1125b1-4748-42ba-93ff-cca4a4ff221b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.450247 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1125b1-4748-42ba-93ff-cca4a4ff221b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.450722 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1125b1-4748-42ba-93ff-cca4a4ff221b admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.451818 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1125b1-4748-42ba-93ff-cca4a4ff221b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:31.452370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1125b1-4748-42ba-93ff-cca4a4ff221b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.454436 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1125b1-4748-42ba-93ff-cca4a4ff221b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.472794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 371/742] 10.222.0.16 () {56 vars in 1171 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:31.479244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f9171-e28d-4144-bb7f-5efdab69c4a7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.489920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f9171-e28d-4144-bb7f-5efdab69c4a7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.494702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7ed40-a5fb-4950-be96-fd4a13b8c444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.495636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7ed40-a5fb-4950-be96-fd4a13b8c444 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.496113 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7ed40-a5fb-4950-be96-fd4a13b8c444 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.496711 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7ed40-a5fb-4950-be96-fd4a13b8c444 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.505541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7ed40-a5fb-4950-be96-fd4a13b8c444 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.507613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7ed40-a5fb-4950-be96-fd4a13b8c444 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.517703 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 372/743] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:31.525036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1125b1-4748-42ba-93ff-cca4a4ff221b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.535822 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1125b1-4748-42ba-93ff-cca4a4ff221b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.540658 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673163e-2a56-403b-9ad7-878842e44b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.541716 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673163e-2a56-403b-9ad7-878842e44b1d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.542226 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673163e-2a56-403b-9ad7-878842e44b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.542698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673163e-2a56-403b-9ad7-878842e44b1d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.557792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673163e-2a56-403b-9ad7-878842e44b1d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.560017 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673163e-2a56-403b-9ad7-878842e44b1d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.578240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-9673163e-2a56-403b-9ad7-878842e44b1d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:31.579991 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 372/744] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:31.586991 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7ed40-a5fb-4950-be96-fd4a13b8c444 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.596211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7ed40-a5fb-4950-be96-fd4a13b8c444 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.601999 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711dd7f-fa25-4a6c-8e5a-d08b4aa252cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.602931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711dd7f-fa25-4a6c-8e5a-d08b4aa252cc admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.603472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711dd7f-fa25-4a6c-8e5a-d08b4aa252cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.603942 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711dd7f-fa25-4a6c-8e5a-d08b4aa252cc admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.604842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711dd7f-fa25-4a6c-8e5a-d08b4aa252cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:31.605405 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711dd7f-fa25-4a6c-8e5a-d08b4aa252cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.607238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711dd7f-fa25-4a6c-8e5a-d08b4aa252cc admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.619212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 373/745] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:31.625287 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673163e-2a56-403b-9ad7-878842e44b1d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.635588 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673163e-2a56-403b-9ad7-878842e44b1d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.640433 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776cc72-1d5e-40a5-b64f-c42fdf59f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.641504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776cc72-1d5e-40a5-b64f-c42fdf59f40c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.642010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776cc72-1d5e-40a5-b64f-c42fdf59f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.642531 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776cc72-1d5e-40a5-b64f-c42fdf59f40c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.650413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776cc72-1d5e-40a5-b64f-c42fdf59f40c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.652698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776cc72-1d5e-40a5-b64f-c42fdf59f40c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.666515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-7776cc72-1d5e-40a5-b64f-c42fdf59f40c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:31.668263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 373/746] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:31.674737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711dd7f-fa25-4a6c-8e5a-d08b4aa252cc admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.685307 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711dd7f-fa25-4a6c-8e5a-d08b4aa252cc admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.690191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caead93-10f4-49f2-ac5c-6a6399a37277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.691746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caead93-10f4-49f2-ac5c-6a6399a37277 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.692276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caead93-10f4-49f2-ac5c-6a6399a37277 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.692745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caead93-10f4-49f2-ac5c-6a6399a37277 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.693772 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caead93-10f4-49f2-ac5c-6a6399a37277 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:31.694437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caead93-10f4-49f2-ac5c-6a6399a37277 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.696471 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caead93-10f4-49f2-ac5c-6a6399a37277 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.710990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 374/747] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:31.717807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776cc72-1d5e-40a5-b64f-c42fdf59f40c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:31.728687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776cc72-1d5e-40a5-b64f-c42fdf59f40c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:31.733675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe806f3-405e-4294-8cd9-143613a1ebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:31.734624 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe806f3-405e-4294-8cd9-143613a1ebec admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:31.735104 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe806f3-405e-4294-8cd9-143613a1ebec admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:31.735621 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe806f3-405e-4294-8cd9-143613a1ebec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:31.736642 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe806f3-405e-4294-8cd9-143613a1ebec admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=afee50dd81e5484081d4aef1c119a129) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:31.737146 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe806f3-405e-4294-8cd9-143613a1ebec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:31.739341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe806f3-405e-4294-8cd9-143613a1ebec admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:31.745897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 374/748] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:31 2021] GET /identity/v3/role_assignments?user.id=afee50dd81e5484081d4aef1c119a129&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:32.269774 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31963bd-f5b4-498f-8537-5dbf230ad784 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:32.270292 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31963bd-f5b4-498f-8537-5dbf230ad784 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:32.270674 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31963bd-f5b4-498f-8537-5dbf230ad784 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:32.272785 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 375/749] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:32.279238 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cbac2-4db1-4b83-bcb2-9862858b7218 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:32.279695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cbac2-4db1-4b83-bcb2-9862858b7218 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:32.280007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cbac2-4db1-4b83-bcb2-9862858b7218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:32.297995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0a9cbac2-4db1-4b83-bcb2-9862858b7218 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:32.299194 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0a9cbac2-4db1-4b83-bcb2-9862858b7218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:32.308129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 375/750] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:32 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:32.334453 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31963bd-f5b4-498f-8537-5dbf230ad784 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:32.346828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31963bd-f5b4-498f-8537-5dbf230ad784 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:32.351875 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaef6e-4372-4bc3-a6c3-17bf30cc3ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:32.352662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaef6e-4372-4bc3-a6c3-17bf30cc3ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:32.352943 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaef6e-4372-4bc3-a6c3-17bf30cc3ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:32.353216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaef6e-4372-4bc3-a6c3-17bf30cc3ac4 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:32.353889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbaef6e-4372-4bc3-a6c3-17bf30cc3ac4 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:32.355495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbaef6e-4372-4bc3-a6c3-17bf30cc3ac4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:32.367808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-ddbaef6e-4372-4bc3-a6c3-17bf30cc3ac4 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 14:18:32.369272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 376/751] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:18:32 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:32.375917 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cbac2-4db1-4b83-bcb2-9862858b7218 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:32.386391 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cbac2-4db1-4b83-bcb2-9862858b7218 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:32.390981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c0a0e-b7b4-46e6-bd12-1755ff20756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:32.391638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c0a0e-b7b4-46e6-bd12-1755ff20756c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:32.391921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c0a0e-b7b4-46e6-bd12-1755ff20756c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:32.392197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c0a0e-b7b4-46e6-bd12-1755ff20756c admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:32.392909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c0a0e-b7b4-46e6-bd12-1755ff20756c admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:32.393217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c0a0e-b7b4-46e6-bd12-1755ff20756c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:32.395277 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c0a0e-b7b4-46e6-bd12-1755ff20756c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:32.400236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 376/752] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:18:32 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:32.406346 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaef6e-4372-4bc3-a6c3-17bf30cc3ac4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:32.417538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaef6e-4372-4bc3-a6c3-17bf30cc3ac4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:32.422318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f30426-83bd-4fbf-a094-145610ba6ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:32.423178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30426-83bd-4fbf-a094-145610ba6ccc admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:32.423638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30426-83bd-4fbf-a094-145610ba6ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:32.424168 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30426-83bd-4fbf-a094-145610ba6ccc admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:32.425618 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f30426-83bd-4fbf-a094-145610ba6ccc admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:32.426154 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f30426-83bd-4fbf-a094-145610ba6ccc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:32.427933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f30426-83bd-4fbf-a094-145610ba6ccc admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:32.433419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 377/753] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:18:32 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:32.868648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a851ee-523e-4735-80bc-77c68b823f90 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:32.868935 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a851ee-523e-4735-80bc-77c68b823f90 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:32.869216 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a851ee-523e-4735-80bc-77c68b823f90 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:32.871298 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 377/754] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:32.877370 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b664a-1856-4afb-8462-bfb0fe5afd1e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:32.877664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b664a-1856-4afb-8462-bfb0fe5afd1e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:32.878570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b664a-1856-4afb-8462-bfb0fe5afd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:32.897777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b58b664a-1856-4afb-8462-bfb0fe5afd1e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:32.899009 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b58b664a-1856-4afb-8462-bfb0fe5afd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:32.907407 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 378/755] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:32 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:32.933093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a851ee-523e-4735-80bc-77c68b823f90 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:32.946466 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a851ee-523e-4735-80bc-77c68b823f90 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:32.950911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4fbaa-8660-4040-9276-c26e8260a133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:32.951703 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4fbaa-8660-4040-9276-c26e8260a133 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:32.954024 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4fbaa-8660-4040-9276-c26e8260a133 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:32.954024 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4fbaa-8660-4040-9276-c26e8260a133 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:32.963343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4fbaa-8660-4040-9276-c26e8260a133 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:32.970328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-b2e4fbaa-8660-4040-9276-c26e8260a133 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:18:32.971898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 378/756] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:32.978866 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b664a-1856-4afb-8462-bfb0fe5afd1e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:32.988806 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b664a-1856-4afb-8462-bfb0fe5afd1e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:32.993424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2796d9-5917-4502-b483-6a4487adf5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:32.994125 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2796d9-5917-4502-b483-6a4487adf5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:32.994411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2796d9-5917-4502-b483-6a4487adf5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:32.994683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2796d9-5917-4502-b483-6a4487adf5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:32.995434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2796d9-5917-4502-b483-6a4487adf5e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:32.995737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2796d9-5917-4502-b483-6a4487adf5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:32.997523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2796d9-5917-4502-b483-6a4487adf5e3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:33.010711 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 379/757] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:33.014010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4fbaa-8660-4040-9276-c26e8260a133 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:33.024862 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4fbaa-8660-4040-9276-c26e8260a133 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:33.029879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986e4aa-01f4-4860-aad6-638b4eb4e2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:33.030691 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986e4aa-01f4-4860-aad6-638b4eb4e2ba admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.030971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986e4aa-01f4-4860-aad6-638b4eb4e2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.031242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986e4aa-01f4-4860-aad6-638b4eb4e2ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.043160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986e4aa-01f4-4860-aad6-638b4eb4e2ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:33.045014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986e4aa-01f4-4860-aad6-638b4eb4e2ba admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:33.062900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-f986e4aa-01f4-4860-aad6-638b4eb4e2ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:33.064406 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 379/758] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:33.071655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2796d9-5917-4502-b483-6a4487adf5e3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:33.081628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2796d9-5917-4502-b483-6a4487adf5e3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:33.086272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad0d86-8014-4c24-8223-fa1307fb2341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:33.086930 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad0d86-8014-4c24-8223-fa1307fb2341 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.087214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad0d86-8014-4c24-8223-fa1307fb2341 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.087491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad0d86-8014-4c24-8223-fa1307fb2341 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.088217 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad0d86-8014-4c24-8223-fa1307fb2341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:33.088520 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad0d86-8014-4c24-8223-fa1307fb2341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:33.090149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad0d86-8014-4c24-8223-fa1307fb2341 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:33.102920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 380/759] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:33.108902 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986e4aa-01f4-4860-aad6-638b4eb4e2ba admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:33.119579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986e4aa-01f4-4860-aad6-638b4eb4e2ba admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:33.124011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506e4ea-5d5d-40d2-a99a-ff519fc9c3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:33.124867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e4ea-5d5d-40d2-a99a-ff519fc9c3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.125146 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e4ea-5d5d-40d2-a99a-ff519fc9c3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.125469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e4ea-5d5d-40d2-a99a-ff519fc9c3d4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.134043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506e4ea-5d5d-40d2-a99a-ff519fc9c3d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:33.136070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506e4ea-5d5d-40d2-a99a-ff519fc9c3d4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:33.150437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-4506e4ea-5d5d-40d2-a99a-ff519fc9c3d4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 14:18:33.151916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 380/760] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:33 2021] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:33.158240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad0d86-8014-4c24-8223-fa1307fb2341 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:33.168745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad0d86-8014-4c24-8223-fa1307fb2341 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:33.173337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33505a-d3bb-42ca-aad9-0795c4cb97fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:33.174075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33505a-d3bb-42ca-aad9-0795c4cb97fb admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.174356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33505a-d3bb-42ca-aad9-0795c4cb97fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.174631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33505a-d3bb-42ca-aad9-0795c4cb97fb admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.176171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33505a-d3bb-42ca-aad9-0795c4cb97fb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:33.176487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33505a-d3bb-42ca-aad9-0795c4cb97fb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:33.178472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33505a-d3bb-42ca-aad9-0795c4cb97fb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:33.196730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 381/761] 10.222.0.16 () {56 vars in 1157 bytes} [Sun Aug 29 14:18:33 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:33.203281 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506e4ea-5d5d-40d2-a99a-ff519fc9c3d4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:33.213286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506e4ea-5d5d-40d2-a99a-ff519fc9c3d4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:33.217808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1aa6c-27c7-4058-ae7b-78727d9110b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:33.218518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1aa6c-27c7-4058-ae7b-78727d9110b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.218798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1aa6c-27c7-4058-ae7b-78727d9110b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.219071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1aa6c-27c7-4058-ae7b-78727d9110b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.227657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1aa6c-27c7-4058-ae7b-78727d9110b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:33.229457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1aa6c-27c7-4058-ae7b-78727d9110b9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:33.239530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 381/762] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:33 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:33.245847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33505a-d3bb-42ca-aad9-0795c4cb97fb admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:33.256158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33505a-d3bb-42ca-aad9-0795c4cb97fb admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:33.261160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b709d4-2d07-4116-b545-a98739f87f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:33.262146 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b709d4-2d07-4116-b545-a98739f87f85 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.262463 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b709d4-2d07-4116-b545-a98739f87f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.262741 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b709d4-2d07-4116-b545-a98739f87f85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.274166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b709d4-2d07-4116-b545-a98739f87f85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:33.276208 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b709d4-2d07-4116-b545-a98739f87f85 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:33.295840 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-d1b709d4-2d07-4116-b545-a98739f87f85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:33.297516 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 382/763] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:33.305089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1aa6c-27c7-4058-ae7b-78727d9110b9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:33.314357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1aa6c-27c7-4058-ae7b-78727d9110b9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:33.319109 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d468fb0-e34c-4e33-b1db-509ee250614d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:33.319767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d468fb0-e34c-4e33-b1db-509ee250614d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.320102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d468fb0-e34c-4e33-b1db-509ee250614d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.320376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d468fb0-e34c-4e33-b1db-509ee250614d admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.321146 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d468fb0-e34c-4e33-b1db-509ee250614d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:33.321453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d468fb0-e34c-4e33-b1db-509ee250614d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:33.323102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d468fb0-e34c-4e33-b1db-509ee250614d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:33.339281 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 382/764] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:33.345164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b709d4-2d07-4116-b545-a98739f87f85 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:33.355543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b709d4-2d07-4116-b545-a98739f87f85 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:33.360067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b305bf8-fdef-4fb5-b306-b4ef78c8a8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:33.360860 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305bf8-fdef-4fb5-b306-b4ef78c8a8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.361146 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305bf8-fdef-4fb5-b306-b4ef78c8a8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.361420 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305bf8-fdef-4fb5-b306-b4ef78c8a8c4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.369239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b305bf8-fdef-4fb5-b306-b4ef78c8a8c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:33.371382 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b305bf8-fdef-4fb5-b306-b4ef78c8a8c4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:33.373122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0a75-809a-4284-8eac-712ed78a922d None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.373419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0a75-809a-4284-8eac-712ed78a922d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.373701 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0a75-809a-4284-8eac-712ed78a922d None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.375766 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 383/765] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:33.381566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5481622-6df7-4e46-b831-da6fc2e9a053 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.381853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5481622-6df7-4e46-b831-da6fc2e9a053 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.382154 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5481622-6df7-4e46-b831-da6fc2e9a053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.385030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-4b305bf8-fdef-4fb5-b306-b4ef78c8a8c4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:33.386590 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 383/766] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:33.392707 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b305bf8-fdef-4fb5-b306-b4ef78c8a8c4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:33.401729 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e5481622-6df7-4e46-b831-da6fc2e9a053 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:33.402941 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e5481622-6df7-4e46-b831-da6fc2e9a053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:33.403182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b305bf8-fdef-4fb5-b306-b4ef78c8a8c4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:33.408038 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001904e3-313e-4f76-a4bd-c271b2a32a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:33.408652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001904e3-313e-4f76-a4bd-c271b2a32a10 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.408940 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001904e3-313e-4f76-a4bd-c271b2a32a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.410084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001904e3-313e-4f76-a4bd-c271b2a32a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.410876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001904e3-313e-4f76-a4bd-c271b2a32a10 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:33.411179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001904e3-313e-4f76-a4bd-c271b2a32a10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:33.412210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 384/767] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:33 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:33.413005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001904e3-313e-4f76-a4bd-c271b2a32a10 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:33.426240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 384/768] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:33.432735 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5481622-6df7-4e46-b831-da6fc2e9a053 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:33.438998 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001904e3-313e-4f76-a4bd-c271b2a32a10 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:33.448857 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5481622-6df7-4e46-b831-da6fc2e9a053 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:33.449132 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001904e3-313e-4f76-a4bd-c271b2a32a10 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:33.455273 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f63a1-def2-44e0-a6d4-9beba1bca55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:33.455953 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f63a1-def2-44e0-a6d4-9beba1bca55e admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.456232 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f63a1-def2-44e0-a6d4-9beba1bca55e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.456680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f63a1-def2-44e0-a6d4-9beba1bca55e admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.457394 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f63a1-def2-44e0-a6d4-9beba1bca55e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:33.458471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39df105-371d-4c71-b5f4-02f19e78fde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:33.459002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f63a1-def2-44e0-a6d4-9beba1bca55e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:33.459566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39df105-371d-4c71-b5f4-02f19e78fde7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:33.460056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39df105-371d-4c71-b5f4-02f19e78fde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:33.460567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39df105-371d-4c71-b5f4-02f19e78fde7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:33.462200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39df105-371d-4c71-b5f4-02f19e78fde7 admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=f37041a9727e4ab6a5c52b00327e7a19) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:33.463018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39df105-371d-4c71-b5f4-02f19e78fde7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:33.464898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39df105-371d-4c71-b5f4-02f19e78fde7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:33.471244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 385/769] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:33 2021] GET /identity/v3/role_assignments?user.id=f37041a9727e4ab6a5c52b00327e7a19&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:33.554264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 385/770] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:18:33 2021] POST /identity/v3/services => generated 269 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:34.078630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a1135-350d-4bad-a08d-a5954bd286b6 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.079197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a1135-350d-4bad-a08d-a5954bd286b6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.079616 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a1135-350d-4bad-a08d-a5954bd286b6 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.082020 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 386/771] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:34.088047 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e603e1f-c990-46f8-bc31-4b68dc72e1cd None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.088499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e603e1f-c990-46f8-bc31-4b68dc72e1cd None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.088930 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e603e1f-c990-46f8-bc31-4b68dc72e1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.107949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-2e603e1f-c990-46f8-bc31-4b68dc72e1cd None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:34.109323 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2e603e1f-c990-46f8-bc31-4b68dc72e1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:34.133970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 386/772] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:34 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:34.152578 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a1135-350d-4bad-a08d-a5954bd286b6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.165478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a1135-350d-4bad-a08d-a5954bd286b6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.170071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3b152-8d8a-462a-81d1-a4a17e3397e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.171040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3b152-8d8a-462a-81d1-a4a17e3397e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.171462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3b152-8d8a-462a-81d1-a4a17e3397e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.171870 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3b152-8d8a-462a-81d1-a4a17e3397e6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.182708 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3b152-8d8a-462a-81d1-a4a17e3397e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:34.190158 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-67f3b152-8d8a-462a-81d1-a4a17e3397e6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 14:18:34.197011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 387/773] 10.222.0.16 () {56 vars in 1142 bytes} [Sun Aug 29 14:18:34 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:34.198539 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e603e1f-c990-46f8-bc31-4b68dc72e1cd None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.208325 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e603e1f-c990-46f8-bc31-4b68dc72e1cd None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.213097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a690f18-8d8b-4f8f-a830-5c7670d18007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.213955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a690f18-8d8b-4f8f-a830-5c7670d18007 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.214379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a690f18-8d8b-4f8f-a830-5c7670d18007 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.214794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a690f18-8d8b-4f8f-a830-5c7670d18007 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.215692 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a690f18-8d8b-4f8f-a830-5c7670d18007 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:34.216223 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a690f18-8d8b-4f8f-a830-5c7670d18007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:34.217985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a690f18-8d8b-4f8f-a830-5c7670d18007 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:34.227469 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 387/774] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Aug 29 14:18:34 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:34.236032 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3b152-8d8a-462a-81d1-a4a17e3397e6 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.248010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3b152-8d8a-462a-81d1-a4a17e3397e6 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.252978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a603d52-a682-49fb-b726-5398b38055ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.253985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a603d52-a682-49fb-b726-5398b38055ed admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.254407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a603d52-a682-49fb-b726-5398b38055ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.254819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a603d52-a682-49fb-b726-5398b38055ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.265732 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a603d52-a682-49fb-b726-5398b38055ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:34.267787 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a603d52-a682-49fb-b726-5398b38055ed admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:34.285207 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-5a603d52-a682-49fb-b726-5398b38055ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:34.286592 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 388/775] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:34.293008 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a690f18-8d8b-4f8f-a830-5c7670d18007 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.303568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a690f18-8d8b-4f8f-a830-5c7670d18007 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.308413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8024af7-1159-4d85-a256-72b1a308a188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.309238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8024af7-1159-4d85-a256-72b1a308a188 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.309664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8024af7-1159-4d85-a256-72b1a308a188 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.310126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8024af7-1159-4d85-a256-72b1a308a188 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.310990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8024af7-1159-4d85-a256-72b1a308a188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:34.311451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8024af7-1159-4d85-a256-72b1a308a188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:34.313176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8024af7-1159-4d85-a256-72b1a308a188 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:34.329973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 388/776] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:34.333317 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a603d52-a682-49fb-b726-5398b38055ed admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.344911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a603d52-a682-49fb-b726-5398b38055ed admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.348358 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad6924-7d5e-4c9d-9b51-3087d49540c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.349169 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6924-7d5e-4c9d-9b51-3087d49540c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.349448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6924-7d5e-4c9d-9b51-3087d49540c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.349721 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6924-7d5e-4c9d-9b51-3087d49540c0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.358049 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad6924-7d5e-4c9d-9b51-3087d49540c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:34.360057 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad6924-7d5e-4c9d-9b51-3087d49540c0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:34.374181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-f2ad6924-7d5e-4c9d-9b51-3087d49540c0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 14:18:34.375699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 389/777] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Aug 29 14:18:34 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:34.382357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8024af7-1159-4d85-a256-72b1a308a188 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.395623 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8024af7-1159-4d85-a256-72b1a308a188 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.400881 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c74fb7-610d-4012-96b7-9c5084888612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.401828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c74fb7-610d-4012-96b7-9c5084888612 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.402353 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c74fb7-610d-4012-96b7-9c5084888612 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.402820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c74fb7-610d-4012-96b7-9c5084888612 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.403854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c74fb7-610d-4012-96b7-9c5084888612 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:34.404368 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c74fb7-610d-4012-96b7-9c5084888612 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:34.406432 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c74fb7-610d-4012-96b7-9c5084888612 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:34.429968 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 389/778] 10.222.0.16 () {56 vars in 1171 bytes} [Sun Aug 29 14:18:34 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:34.433382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad6924-7d5e-4c9d-9b51-3087d49540c0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.443366 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad6924-7d5e-4c9d-9b51-3087d49540c0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.448230 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e927e-c1a3-41f2-a00e-d479e9095885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.449089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e927e-c1a3-41f2-a00e-d479e9095885 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.449568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e927e-c1a3-41f2-a00e-d479e9095885 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.450070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e927e-c1a3-41f2-a00e-d479e9095885 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.459192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e927e-c1a3-41f2-a00e-d479e9095885 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:34.461175 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e927e-c1a3-41f2-a00e-d479e9095885 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:34.476579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 390/779] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:34 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:34.478273 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c74fb7-610d-4012-96b7-9c5084888612 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.488529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c74fb7-610d-4012-96b7-9c5084888612 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.493371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48cdc3-1935-470b-a362-28aa05750542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.494437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48cdc3-1935-470b-a362-28aa05750542 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.494918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48cdc3-1935-470b-a362-28aa05750542 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.495385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48cdc3-1935-470b-a362-28aa05750542 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.506493 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48cdc3-1935-470b-a362-28aa05750542 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:34.508889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48cdc3-1935-470b-a362-28aa05750542 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:34.526883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-4d48cdc3-1935-470b-a362-28aa05750542 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:34.532553 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 390/780] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:34.535752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e927e-c1a3-41f2-a00e-d479e9095885 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.544855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e927e-c1a3-41f2-a00e-d479e9095885 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.549821 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747feb33-1b41-41bb-84da-31983e6b3d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.550810 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747feb33-1b41-41bb-84da-31983e6b3d99 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.551290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747feb33-1b41-41bb-84da-31983e6b3d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.551762 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747feb33-1b41-41bb-84da-31983e6b3d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.552677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747feb33-1b41-41bb-84da-31983e6b3d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:34.553213 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747feb33-1b41-41bb-84da-31983e6b3d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:34.555034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747feb33-1b41-41bb-84da-31983e6b3d99 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:34.572712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 391/781] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:34.574337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48cdc3-1935-470b-a362-28aa05750542 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.585099 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48cdc3-1935-470b-a362-28aa05750542 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.589998 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f70852-8dc3-487b-843f-8bd06adf14c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.591068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f70852-8dc3-487b-843f-8bd06adf14c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.591548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f70852-8dc3-487b-843f-8bd06adf14c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.592036 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f70852-8dc3-487b-843f-8bd06adf14c2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.600284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f70852-8dc3-487b-843f-8bd06adf14c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:34.602653 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f70852-8dc3-487b-843f-8bd06adf14c2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:34.616530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-27f70852-8dc3-487b-843f-8bd06adf14c2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:34.622018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 391/782] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:34.625547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747feb33-1b41-41bb-84da-31983e6b3d99 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.636804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747feb33-1b41-41bb-84da-31983e6b3d99 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.642135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570fc7c-029c-4c72-8fa2-90f1c56dec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.643217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570fc7c-029c-4c72-8fa2-90f1c56dec1b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.644529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570fc7c-029c-4c72-8fa2-90f1c56dec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.645019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570fc7c-029c-4c72-8fa2-90f1c56dec1b admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.646216 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570fc7c-029c-4c72-8fa2-90f1c56dec1b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:34.646773 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570fc7c-029c-4c72-8fa2-90f1c56dec1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:34.648883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570fc7c-029c-4c72-8fa2-90f1c56dec1b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:34.666712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 392/783] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:34.670059 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f70852-8dc3-487b-843f-8bd06adf14c2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.682368 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f70852-8dc3-487b-843f-8bd06adf14c2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.687432 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933a944-dccc-4360-82e9-74338a8d394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.688335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933a944-dccc-4360-82e9-74338a8d394d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.688814 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933a944-dccc-4360-82e9-74338a8d394d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.689284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933a944-dccc-4360-82e9-74338a8d394d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.690906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933a944-dccc-4360-82e9-74338a8d394d admin admin] RBAC: Adding query filter params (role.id=e1eed6eb3c344f43bd3ea8c3751a272f, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=afee50dd81e5484081d4aef1c119a129) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:34.691524 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933a944-dccc-4360-82e9-74338a8d394d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:34.693678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933a944-dccc-4360-82e9-74338a8d394d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:34.706644 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 392/784] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:34 2021] GET /identity/v3/role_assignments?user.id=afee50dd81e5484081d4aef1c119a129&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=e1eed6eb3c344f43bd3ea8c3751a272f => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:34.717407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a8d29-c6a8-450d-96ae-ce13c74472e9 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.718027 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a8d29-c6a8-450d-96ae-ce13c74472e9 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.718584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a8d29-c6a8-450d-96ae-ce13c74472e9 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.720530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 393/785] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:34.727278 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443a654-a42e-4809-871c-f7889d2dcf76 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.727584 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443a654-a42e-4809-871c-f7889d2dcf76 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.727827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443a654-a42e-4809-871c-f7889d2dcf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.746902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b443a654-a42e-4809-871c-f7889d2dcf76 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:34.748158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b443a654-a42e-4809-871c-f7889d2dcf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:34.758018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 393/786] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:34 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:34.786261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a8d29-c6a8-450d-96ae-ce13c74472e9 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:34.799503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a8d29-c6a8-450d-96ae-ce13c74472e9 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:34.804491 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd712c1b-6226-44c1-9e44-d14072aad36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:34.805188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd712c1b-6226-44c1-9e44-d14072aad36f admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:34.805446 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd712c1b-6226-44c1-9e44-d14072aad36f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:34.805718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd712c1b-6226-44c1-9e44-d14072aad36f admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:34.806486 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd712c1b-6226-44c1-9e44-d14072aad36f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:34.808091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd712c1b-6226-44c1-9e44-d14072aad36f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:34.897059 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 394/787] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:18:34 2021] POST /identity/v3/services => generated 251 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:35.773881 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218fb9a-2e92-4503-9760-bc2bbbb59709 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:35.774429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218fb9a-2e92-4503-9760-bc2bbbb59709 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:35.774429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218fb9a-2e92-4503-9760-bc2bbbb59709 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:35.776442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 394/788] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:35.782611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41548639-c88f-4548-99d9-29409d7ceee9 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:35.783021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41548639-c88f-4548-99d9-29409d7ceee9 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:35.783188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41548639-c88f-4548-99d9-29409d7ceee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:35.801680 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-41548639-c88f-4548-99d9-29409d7ceee9 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:35.802925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-41548639-c88f-4548-99d9-29409d7ceee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:35.804283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34511e7-6fc0-4a7b-92c5-35b9274b51a8 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:35.804568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34511e7-6fc0-4a7b-92c5-35b9274b51a8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:35.804850 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34511e7-6fc0-4a7b-92c5-35b9274b51a8 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:35.806865 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 395/789] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:35.812761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9d5e8-c352-4da2-bb6b-4f8a67533f7d None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:35.813045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9d5e8-c352-4da2-bb6b-4f8a67533f7d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:35.813324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9d5e8-c352-4da2-bb6b-4f8a67533f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:35.820813 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 395/790] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:35 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:35.831594 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-f3b9d5e8-c352-4da2-bb6b-4f8a67533f7d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:35.832900 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f3b9d5e8-c352-4da2-bb6b-4f8a67533f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:35.840949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 396/791] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:35 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:35.844186 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41548639-c88f-4548-99d9-29409d7ceee9 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:35.853368 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41548639-c88f-4548-99d9-29409d7ceee9 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:35.857899 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a362667-2ebb-449a-b5b6-25db586cc7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:35.858695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362667-2ebb-449a-b5b6-25db586cc7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:35.858971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362667-2ebb-449a-b5b6-25db586cc7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:35.859242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362667-2ebb-449a-b5b6-25db586cc7b4 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:35.859889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a362667-2ebb-449a-b5b6-25db586cc7b4 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:35.861452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a362667-2ebb-449a-b5b6-25db586cc7b4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:35.866220 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9d5e8-c352-4da2-bb6b-4f8a67533f7d None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:35.873576 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-4a362667-2ebb-449a-b5b6-25db586cc7b4 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 14:18:35.875029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 396/792] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Aug 29 14:18:35 2021] GET /identity/v3/services/object-store => generated 93 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:35.875648 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9d5e8-c352-4da2-bb6b-4f8a67533f7d None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:35.881400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa560-708e-4167-9782-4214f7dee041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:35.881957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a362667-2ebb-449a-b5b6-25db586cc7b4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:35.882438 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa560-708e-4167-9782-4214f7dee041 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:35.882819 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa560-708e-4167-9782-4214f7dee041 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:35.883446 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa560-708e-4167-9782-4214f7dee041 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:35.884197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaa560-708e-4167-9782-4214f7dee041 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:35.885926 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaa560-708e-4167-9782-4214f7dee041 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:35.891562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a362667-2ebb-449a-b5b6-25db586cc7b4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:35.896112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9f39b-535e-438b-b077-16bab07e8137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:35.896732 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9f39b-535e-438b-b077-16bab07e8137 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:35.897010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9f39b-535e-438b-b077-16bab07e8137 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:35.897280 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9f39b-535e-438b-b077-16bab07e8137 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:35.897984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-fadaa560-708e-4167-9782-4214f7dee041 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 14:18:35.898090 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9f39b-535e-438b-b077-16bab07e8137 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:35.898289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9f39b-535e-438b-b077-16bab07e8137 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:35.899805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 397/793] 10.222.0.16 () {56 vars in 1154 bytes} [Sun Aug 29 14:18:35 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:35.899919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9f39b-535e-438b-b077-16bab07e8137 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:35.904933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 397/794] 10.222.0.16 () {56 vars in 1144 bytes} [Sun Aug 29 14:18:35 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:35.906592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa560-708e-4167-9782-4214f7dee041 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:35.911258 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9f39b-535e-438b-b077-16bab07e8137 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:35.916981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa560-708e-4167-9782-4214f7dee041 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:35.921279 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9f39b-535e-438b-b077-16bab07e8137 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:35.922219 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b3083-e163-4bd5-81c9-4a995b493b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:35.923006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b3083-e163-4bd5-81c9-4a995b493b70 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:35.923346 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b3083-e163-4bd5-81c9-4a995b493b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:35.923691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b3083-e163-4bd5-81c9-4a995b493b70 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:35.925040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b3083-e163-4bd5-81c9-4a995b493b70 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:35.925545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b3083-e163-4bd5-81c9-4a995b493b70 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:35.927174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847afdf-cd67-4196-9c42-3aa9c74ec637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:35.927321 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b3083-e163-4bd5-81c9-4a995b493b70 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:35.927981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847afdf-cd67-4196-9c42-3aa9c74ec637 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:35.928325 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847afdf-cd67-4196-9c42-3aa9c74ec637 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:35.928661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847afdf-cd67-4196-9c42-3aa9c74ec637 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:35.929663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847afdf-cd67-4196-9c42-3aa9c74ec637 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:35.930027 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847afdf-cd67-4196-9c42-3aa9c74ec637 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:35.931632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847afdf-cd67-4196-9c42-3aa9c74ec637 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:35.936718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 398/795] 10.222.0.16 () {56 vars in 1144 bytes} [Sun Aug 29 14:18:35 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:35.936963 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 398/796] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Aug 29 14:18:35 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:35.944515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847afdf-cd67-4196-9c42-3aa9c74ec637 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:35.958814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847afdf-cd67-4196-9c42-3aa9c74ec637 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:35.964120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc908c2-46a4-492a-8183-523afe2458ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:35.964883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc908c2-46a4-492a-8183-523afe2458ee admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:35.965163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc908c2-46a4-492a-8183-523afe2458ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:35.965441 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc908c2-46a4-492a-8183-523afe2458ee admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:35.966271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc908c2-46a4-492a-8183-523afe2458ee admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:35.966619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc908c2-46a4-492a-8183-523afe2458ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:35.968255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc908c2-46a4-492a-8183-523afe2458ee admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:35.974627 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 399/797] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Aug 29 14:18:35 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:35.981356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b3083-e163-4bd5-81c9-4a995b493b70 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:35.993059 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b3083-e163-4bd5-81c9-4a995b493b70 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:35.997940 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4ace5-c0a3-4456-bf2d-b4f9447194da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:35.998689 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4ace5-c0a3-4456-bf2d-b4f9447194da admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:35.998961 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4ace5-c0a3-4456-bf2d-b4f9447194da admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:35.999324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4ace5-c0a3-4456-bf2d-b4f9447194da admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:36.000139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4ace5-c0a3-4456-bf2d-b4f9447194da admin admin] RBAC: Adding query filter params (interface=public, service_id=2eaddbead4e84a26a6c6e5e4594d9a9d, region_id=RegionOne) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:36.000445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4ace5-c0a3-4456-bf2d-b4f9447194da admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:36.002136 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4ace5-c0a3-4456-bf2d-b4f9447194da admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:36.009757 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 399/798] 10.222.0.16 () {56 vars in 1273 bytes} [Sun Aug 29 14:18:35 2021] GET /identity/v3/endpoints?service_id=2eaddbead4e84a26a6c6e5e4594d9a9d&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:36.016390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc908c2-46a4-492a-8183-523afe2458ee admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:36.033663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc908c2-46a4-492a-8183-523afe2458ee admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:36.033663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a50a63-0c4b-435e-b980-ea8bb5f30df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:36.034261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a50a63-0c4b-435e-b980-ea8bb5f30df1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:36.034622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a50a63-0c4b-435e-b980-ea8bb5f30df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:36.034995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a50a63-0c4b-435e-b980-ea8bb5f30df1 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:36.036173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a50a63-0c4b-435e-b980-ea8bb5f30df1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:36.039001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a50a63-0c4b-435e-b980-ea8bb5f30df1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:36.076334 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 400/799] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Aug 29 14:18:36 2021] GET /identity/v3/services => generated 1268 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:18:36.942175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f201632-f7b2-44ef-b1e5-4523f328fa4a None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:36.942784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f201632-f7b2-44ef-b1e5-4523f328fa4a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:36.942784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f201632-f7b2-44ef-b1e5-4523f328fa4a None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:36.947325 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 400/800] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:36.957140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87905e5-9a89-463e-a9a0-81d1e24be22b None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:36.957946 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87905e5-9a89-463e-a9a0-81d1e24be22b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:36.958422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87905e5-9a89-463e-a9a0-81d1e24be22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:36.976690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c87905e5-9a89-463e-a9a0-81d1e24be22b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:36.978269 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c87905e5-9a89-463e-a9a0-81d1e24be22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:36.986443 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 401/801] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:36 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:37.011394 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f201632-f7b2-44ef-b1e5-4523f328fa4a None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.024967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f201632-f7b2-44ef-b1e5-4523f328fa4a None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.029678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241cc71-a9a2-495b-aa49-e9959df8f70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.030691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241cc71-a9a2-495b-aa49-e9959df8f70b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.031163 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241cc71-a9a2-495b-aa49-e9959df8f70b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.031612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241cc71-a9a2-495b-aa49-e9959df8f70b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.043332 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241cc71-a9a2-495b-aa49-e9959df8f70b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:37.050959 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-3241cc71-a9a2-495b-aa49-e9959df8f70b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 14:18:37.057776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 401/802] 10.222.0.16 () {56 vars in 1142 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:37.059343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87905e5-9a89-463e-a9a0-81d1e24be22b None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.069561 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87905e5-9a89-463e-a9a0-81d1e24be22b None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.074744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6a286-1fc3-40b5-8473-fc5fc721b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.075759 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6a286-1fc3-40b5-8473-fc5fc721b1da admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.076220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6a286-1fc3-40b5-8473-fc5fc721b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.076674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6a286-1fc3-40b5-8473-fc5fc721b1da admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.077625 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6a286-1fc3-40b5-8473-fc5fc721b1da admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:37.078158 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6a286-1fc3-40b5-8473-fc5fc721b1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.079994 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6a286-1fc3-40b5-8473-fc5fc721b1da admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.095932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 402/803] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:37.098824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241cc71-a9a2-495b-aa49-e9959df8f70b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.109258 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241cc71-a9a2-495b-aa49-e9959df8f70b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.114807 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172de6fa-a45d-4452-8d73-71ce3772f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.115830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172de6fa-a45d-4452-8d73-71ce3772f9ef admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.116294 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172de6fa-a45d-4452-8d73-71ce3772f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.116740 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172de6fa-a45d-4452-8d73-71ce3772f9ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.128417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172de6fa-a45d-4452-8d73-71ce3772f9ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.130744 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172de6fa-a45d-4452-8d73-71ce3772f9ef admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.149540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-172de6fa-a45d-4452-8d73-71ce3772f9ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:37.156311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 402/804] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:37.157834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6a286-1fc3-40b5-8473-fc5fc721b1da admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.163298 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841aa86-5616-4b48-bf25-d97eb6764d45 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.163586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841aa86-5616-4b48-bf25-d97eb6764d45 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.163864 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841aa86-5616-4b48-bf25-d97eb6764d45 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.165886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 403/805] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:37.169628 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6a286-1fc3-40b5-8473-fc5fc721b1da admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.171678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb518ad3-67b1-4d27-97e7-ef44ec659ca4 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.171967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb518ad3-67b1-4d27-97e7-ef44ec659ca4 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.172247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb518ad3-67b1-4d27-97e7-ef44ec659ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.178357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cbce6-6c5e-4ad4-90b6-e4a8044918ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.179470 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cbce6-6c5e-4ad4-90b6-e4a8044918ed admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.179931 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cbce6-6c5e-4ad4-90b6-e4a8044918ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.181260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cbce6-6c5e-4ad4-90b6-e4a8044918ed admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.182209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cbce6-6c5e-4ad4-90b6-e4a8044918ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:37.182696 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cbce6-6c5e-4ad4-90b6-e4a8044918ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.184450 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cbce6-6c5e-4ad4-90b6-e4a8044918ed admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.190958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-cb518ad3-67b1-4d27-97e7-ef44ec659ca4 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:37.192155 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-cb518ad3-67b1-4d27-97e7-ef44ec659ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:37.203892 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 403/807] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:37.205933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 404/807] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:37 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:37.207427 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cbce6-6c5e-4ad4-90b6-e4a8044918ed admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.217518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cbce6-6c5e-4ad4-90b6-e4a8044918ed admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.223139 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd950a-1232-420b-844c-01fe808b7d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.224546 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd950a-1232-420b-844c-01fe808b7d61 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.225016 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb518ad3-67b1-4d27-97e7-ef44ec659ca4 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.225127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd950a-1232-420b-844c-01fe808b7d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.225581 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd950a-1232-420b-844c-01fe808b7d61 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.233823 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb518ad3-67b1-4d27-97e7-ef44ec659ca4 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.235096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd950a-1232-420b-844c-01fe808b7d61 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.238459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd950a-1232-420b-844c-01fe808b7d61 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.239092 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2cf10-1881-4768-81a3-2793be01e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.239870 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2cf10-1881-4768-81a3-2793be01e86d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.240148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2cf10-1881-4768-81a3-2793be01e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.240422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2cf10-1881-4768-81a3-2793be01e86d admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.241074 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2cf10-1881-4768-81a3-2793be01e86d admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.242709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2cf10-1881-4768-81a3-2793be01e86d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.253612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-6bd2cf10-1881-4768-81a3-2793be01e86d admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 14:18:37.255015 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 405/808] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:37.256218 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-83bd950a-1232-420b-844c-01fe808b7d61 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 14:18:37.261963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 404/809] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:37.263581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2cf10-1881-4768-81a3-2793be01e86d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.266742 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd950a-1232-420b-844c-01fe808b7d61 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.273586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2cf10-1881-4768-81a3-2793be01e86d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.278133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce20b8-0590-426b-9060-88b6a46c4989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.278773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce20b8-0590-426b-9060-88b6a46c4989 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.279053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce20b8-0590-426b-9060-88b6a46c4989 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.279328 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce20b8-0590-426b-9060-88b6a46c4989 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.279962 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd950a-1232-420b-844c-01fe808b7d61 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.280096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce20b8-0590-426b-9060-88b6a46c4989 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:37.280310 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce20b8-0590-426b-9060-88b6a46c4989 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.282197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce20b8-0590-426b-9060-88b6a46c4989 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.286694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d34c4-79cb-481d-8889-aa285a252a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.287575 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d34c4-79cb-481d-8889-aa285a252a40 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.288051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d34c4-79cb-481d-8889-aa285a252a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.288585 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d34c4-79cb-481d-8889-aa285a252a40 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.289673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d34c4-79cb-481d-8889-aa285a252a40 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:37.290205 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d34c4-79cb-481d-8889-aa285a252a40 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.292315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d34c4-79cb-481d-8889-aa285a252a40 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.292584 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 406/810] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:37.294292 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce20b8-0590-426b-9060-88b6a46c4989 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.303988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce20b8-0590-426b-9060-88b6a46c4989 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.308662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569247a3-0cea-423d-9ade-82e289ec27d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.309367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569247a3-0cea-423d-9ade-82e289ec27d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.309660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569247a3-0cea-423d-9ade-82e289ec27d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.310340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569247a3-0cea-423d-9ade-82e289ec27d5 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.310719 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569247a3-0cea-423d-9ade-82e289ec27d5 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:37.311023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569247a3-0cea-423d-9ade-82e289ec27d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.312664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569247a3-0cea-423d-9ade-82e289ec27d5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.320179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 405/811] 10.222.0.16 () {56 vars in 1171 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:37.322279 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d34c4-79cb-481d-8889-aa285a252a40 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.330007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 407/812] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:37.331543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569247a3-0cea-423d-9ade-82e289ec27d5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.334806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d34c4-79cb-481d-8889-aa285a252a40 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.340722 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31358104-4152-4429-9442-5b4d8f0d16b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.341750 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31358104-4152-4429-9442-5b4d8f0d16b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.342079 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569247a3-0cea-423d-9ade-82e289ec27d5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.342498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31358104-4152-4429-9442-5b4d8f0d16b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.343063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31358104-4152-4429-9442-5b4d8f0d16b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.347436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce7367-4505-4315-825a-253302805290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.348087 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7367-4505-4315-825a-253302805290 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.348403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7367-4505-4315-825a-253302805290 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.348692 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7367-4505-4315-825a-253302805290 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.349477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce7367-4505-4315-825a-253302805290 admin admin] RBAC: Adding query filter params (interface=public, service_id=6ca4b6fad8494fbf913d4f736228c32f, region_id=RegionOne) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:37.349838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce7367-4505-4315-825a-253302805290 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.351523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce7367-4505-4315-825a-253302805290 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.357117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31358104-4152-4429-9442-5b4d8f0d16b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.359240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31358104-4152-4429-9442-5b4d8f0d16b8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.362311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 408/813] 10.222.0.16 () {56 vars in 1273 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/endpoints?service_id=6ca4b6fad8494fbf913d4f736228c32f&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:37.367125 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce7367-4505-4315-825a-253302805290 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.376722 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce7367-4505-4315-825a-253302805290 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.378852 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-31358104-4152-4429-9442-5b4d8f0d16b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:37.380564 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 406/814] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:37.386521 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355107a-f0d9-4588-bdb5-2d36c6089179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.386760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31358104-4152-4429-9442-5b4d8f0d16b8 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.387518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355107a-f0d9-4588-bdb5-2d36c6089179 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.388073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355107a-f0d9-4588-bdb5-2d36c6089179 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.388448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355107a-f0d9-4588-bdb5-2d36c6089179 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.389286 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355107a-f0d9-4588-bdb5-2d36c6089179 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.391065 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355107a-f0d9-4588-bdb5-2d36c6089179 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.398703 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31358104-4152-4429-9442-5b4d8f0d16b8 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.402221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 409/815] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/services => generated 1268 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:18:37.411170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92ebc6-3124-487f-9f12-fa71407ed321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.412131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92ebc6-3124-487f-9f12-fa71407ed321 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.412557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92ebc6-3124-487f-9f12-fa71407ed321 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.412969 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92ebc6-3124-487f-9f12-fa71407ed321 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.413855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92ebc6-3124-487f-9f12-fa71407ed321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:37.414375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92ebc6-3124-487f-9f12-fa71407ed321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.416177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92ebc6-3124-487f-9f12-fa71407ed321 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.430665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 407/816] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:37.436637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355107a-f0d9-4588-bdb5-2d36c6089179 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.448094 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355107a-f0d9-4588-bdb5-2d36c6089179 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.453172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f52c62-b503-498c-8ded-55633c2eed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.454354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52c62-b503-498c-8ded-55633c2eed4d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.454842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52c62-b503-498c-8ded-55633c2eed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.455312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52c62-b503-498c-8ded-55633c2eed4d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.464318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f52c62-b503-498c-8ded-55633c2eed4d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.466654 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f52c62-b503-498c-8ded-55633c2eed4d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.481561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-81f52c62-b503-498c-8ded-55633c2eed4d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:37.483561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 410/817] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:37.490399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92ebc6-3124-487f-9f12-fa71407ed321 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.500706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92ebc6-3124-487f-9f12-fa71407ed321 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.505804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e41270-fc98-4544-aea1-db3f10e37ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.506646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e41270-fc98-4544-aea1-db3f10e37ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.507026 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e41270-fc98-4544-aea1-db3f10e37ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.507396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e41270-fc98-4544-aea1-db3f10e37ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.508563 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e41270-fc98-4544-aea1-db3f10e37ef1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:37.508972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e41270-fc98-4544-aea1-db3f10e37ef1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.510954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e41270-fc98-4544-aea1-db3f10e37ef1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.525422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 408/818] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:37.532227 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f52c62-b503-498c-8ded-55633c2eed4d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:37.547224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f52c62-b503-498c-8ded-55633c2eed4d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:37.552925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af4dc2-f78a-42b2-be30-1d59ade00038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:37.553893 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af4dc2-f78a-42b2-be30-1d59ade00038 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:37.554245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af4dc2-f78a-42b2-be30-1d59ade00038 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:37.554520 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af4dc2-f78a-42b2-be30-1d59ade00038 admin admin] PATH_INFO: `/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/afee50dd81e5484081d4aef1c119a129/roles/e1eed6eb3c344f43bd3ea8c3751a272f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:37.556932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af4dc2-f78a-42b2-be30-1d59ade00038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c728e9160de45afbd4902c27eef45b3, user_id=afee50dd81e5484081d4aef1c119a129, role_id=e1eed6eb3c344f43bd3ea8c3751a272f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:37.559702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af4dc2-f78a-42b2-be30-1d59ade00038 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:37.633816 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 411/819] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:18:37 2021] PUT /identity/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/afee50dd81e5484081d4aef1c119a129/roles/e1eed6eb3c344f43bd3ea8c3751a272f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:18:38.129771 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099932a-976a-40dc-9eef-53c5526a7a34 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:38.130292 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099932a-976a-40dc-9eef-53c5526a7a34 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:38.130399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099932a-976a-40dc-9eef-53c5526a7a34 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:38.132382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 409/820] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:38.138934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1a0f6-6f68-4d96-beed-8bb4d3dd9b77 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:38.139340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1a0f6-6f68-4d96-beed-8bb4d3dd9b77 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:38.139507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1a0f6-6f68-4d96-beed-8bb4d3dd9b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:38.162372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-2db1a0f6-6f68-4d96-beed-8bb4d3dd9b77 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:38.163890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2db1a0f6-6f68-4d96-beed-8bb4d3dd9b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:38.222704 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 412/821] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:38 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:38.245472 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099932a-976a-40dc-9eef-53c5526a7a34 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:38.258955 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099932a-976a-40dc-9eef-53c5526a7a34 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:38.263329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1183b-9cae-40f9-b19a-f9a9afb3dc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:38.263978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1183b-9cae-40f9-b19a-f9a9afb3dc82 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:38.264258 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1183b-9cae-40f9-b19a-f9a9afb3dc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:38.264531 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1183b-9cae-40f9-b19a-f9a9afb3dc82 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:38.265245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1183b-9cae-40f9-b19a-f9a9afb3dc82 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:38.266840 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1183b-9cae-40f9-b19a-f9a9afb3dc82 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:38.347790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 410/822] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:18:38 2021] POST /identity/v3/services => generated 241 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:38.386675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66b9ea-4d3c-4484-9a70-9f0ae8eb4a12 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:38.386675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66b9ea-4d3c-4484-9a70-9f0ae8eb4a12 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:38.386675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66b9ea-4d3c-4484-9a70-9f0ae8eb4a12 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:38.387429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 413/823] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:38.395196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f76fb-5049-4cc3-9991-ff4df1d24f1f None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:38.395499 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f76fb-5049-4cc3-9991-ff4df1d24f1f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:38.395779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f76fb-5049-4cc3-9991-ff4df1d24f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:38.416310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-178f76fb-5049-4cc3-9991-ff4df1d24f1f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:38.417552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-178f76fb-5049-4cc3-9991-ff4df1d24f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:38.436675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 411/824] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:38 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:38.463310 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66b9ea-4d3c-4484-9a70-9f0ae8eb4a12 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:38.476801 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66b9ea-4d3c-4484-9a70-9f0ae8eb4a12 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:38.485891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded1368-8a3b-4b7c-83f6-b5778c300351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:38.485891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded1368-8a3b-4b7c-83f6-b5778c300351 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:38.485891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded1368-8a3b-4b7c-83f6-b5778c300351 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:38.485891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded1368-8a3b-4b7c-83f6-b5778c300351 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:38.486299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded1368-8a3b-4b7c-83f6-b5778c300351 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:38.486602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded1368-8a3b-4b7c-83f6-b5778c300351 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:38.499493 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-fded1368-8a3b-4b7c-83f6-b5778c300351 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 14:18:38.501095 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 414/825] 10.222.0.16 () {56 vars in 1154 bytes} [Sun Aug 29 14:18:38 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:38.509239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f76fb-5049-4cc3-9991-ff4df1d24f1f None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:38.520224 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f76fb-5049-4cc3-9991-ff4df1d24f1f None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:38.525428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cae54-28d5-443d-9b07-bcfd957abe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:38.526458 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cae54-28d5-443d-9b07-bcfd957abe37 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:38.526972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cae54-28d5-443d-9b07-bcfd957abe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:38.527465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cae54-28d5-443d-9b07-bcfd957abe37 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:38.528397 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cae54-28d5-443d-9b07-bcfd957abe37 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:38.528909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cae54-28d5-443d-9b07-bcfd957abe37 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:38.530826 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cae54-28d5-443d-9b07-bcfd957abe37 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:38.537322 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 412/826] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Aug 29 14:18:38 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:38.544096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded1368-8a3b-4b7c-83f6-b5778c300351 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:38.554969 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded1368-8a3b-4b7c-83f6-b5778c300351 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:38.561121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545169b5-982b-40d4-b7d5-8d0d5b1724b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:38.561792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545169b5-982b-40d4-b7d5-8d0d5b1724b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:38.562099 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545169b5-982b-40d4-b7d5-8d0d5b1724b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:38.562375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545169b5-982b-40d4-b7d5-8d0d5b1724b6 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:38.563080 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545169b5-982b-40d4-b7d5-8d0d5b1724b6 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:38.563385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545169b5-982b-40d4-b7d5-8d0d5b1724b6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:38.565548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545169b5-982b-40d4-b7d5-8d0d5b1724b6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:38.571114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 415/827] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Aug 29 14:18:38 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:38.577211 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cae54-28d5-443d-9b07-bcfd957abe37 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:38.587965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cae54-28d5-443d-9b07-bcfd957abe37 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:38.592631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b93f0-ba2b-4d1e-9dd3-27bb9b6414ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:38.593283 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b93f0-ba2b-4d1e-9dd3-27bb9b6414ce admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:38.593565 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b93f0-ba2b-4d1e-9dd3-27bb9b6414ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:38.593841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b93f0-ba2b-4d1e-9dd3-27bb9b6414ce admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:38.594643 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b93f0-ba2b-4d1e-9dd3-27bb9b6414ce admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:38.596213 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b93f0-ba2b-4d1e-9dd3-27bb9b6414ce admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:38.667584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 413/828] 10.222.0.16 () {60 vars in 1166 bytes} [Sun Aug 29 14:18:38 2021] POST /identity/v3/endpoints => generated 347 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:39.670769 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9b854-f864-485f-abbb-9c0140a90b1e None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:39.671301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9b854-f864-485f-abbb-9c0140a90b1e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:39.671301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9b854-f864-485f-abbb-9c0140a90b1e None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:39.673321 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 416/829] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:39.679595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef2158-08ed-49c3-a2c7-9fefe58cd37c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:39.680105 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef2158-08ed-49c3-a2c7-9fefe58cd37c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:39.680255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef2158-08ed-49c3-a2c7-9fefe58cd37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:39.697703 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-9aef2158-08ed-49c3-a2c7-9fefe58cd37c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:39.698917 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-9aef2158-08ed-49c3-a2c7-9fefe58cd37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:39.722047 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 414/830] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:39 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:39.741767 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9b854-f864-485f-abbb-9c0140a90b1e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:39.755402 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9b854-f864-485f-abbb-9c0140a90b1e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:39.760683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ebd97-c939-4183-a1a5-60cd27dfa541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:39.761901 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ebd97-c939-4183-a1a5-60cd27dfa541 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:39.762413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ebd97-c939-4183-a1a5-60cd27dfa541 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:39.762878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ebd97-c939-4183-a1a5-60cd27dfa541 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:39.763737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ebd97-c939-4183-a1a5-60cd27dfa541 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:39.765601 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ebd97-c939-4183-a1a5-60cd27dfa541 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:39.778564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-951ebd97-c939-4183-a1a5-60cd27dfa541 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 14:18:39.780530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 417/831] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:18:39 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:39.787695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef2158-08ed-49c3-a2c7-9fefe58cd37c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:39.796719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef2158-08ed-49c3-a2c7-9fefe58cd37c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:39.801360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd3641-361b-43bb-9332-334eef80a7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:39.802042 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd3641-361b-43bb-9332-334eef80a7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:39.802322 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd3641-361b-43bb-9332-334eef80a7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:39.802596 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd3641-361b-43bb-9332-334eef80a7e2 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:39.803299 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd3641-361b-43bb-9332-334eef80a7e2 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:39.803602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd3641-361b-43bb-9332-334eef80a7e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:39.805198 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd3641-361b-43bb-9332-334eef80a7e2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:39.815583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 415/832] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:18:39 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:39.816881 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ebd97-c939-4183-a1a5-60cd27dfa541 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:39.831948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ebd97-c939-4183-a1a5-60cd27dfa541 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:39.836286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9a58-e3af-4aea-9513-7f8666089e8b None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:39.836589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f4248-8528-4dbc-9bbe-ffe42ff1b5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:39.837045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9a58-e3af-4aea-9513-7f8666089e8b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:39.837238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f4248-8528-4dbc-9bbe-ffe42ff1b5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:39.837518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f4248-8528-4dbc-9bbe-ffe42ff1b5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:39.837790 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f4248-8528-4dbc-9bbe-ffe42ff1b5b4 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:39.838132 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9a58-e3af-4aea-9513-7f8666089e8b None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:39.838538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f4248-8528-4dbc-9bbe-ffe42ff1b5b4 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:39.838840 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f4248-8528-4dbc-9bbe-ffe42ff1b5b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:39.840434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f4248-8528-4dbc-9bbe-ffe42ff1b5b4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:39.840951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 416/833] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:39 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:39.846746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e02ed-eefc-4036-8cf5-5d6cde0d4837 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:39.846922 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 418/834] 10.222.0.16 () {56 vars in 1136 bytes} [Sun Aug 29 14:18:39 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:39.847034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e02ed-eefc-4036-8cf5-5d6cde0d4837 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:39.847301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e02ed-eefc-4036-8cf5-5d6cde0d4837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:39.856777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f4248-8528-4dbc-9bbe-ffe42ff1b5b4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:39.862326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f4248-8528-4dbc-9bbe-ffe42ff1b5b4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:39.866973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6a4ab-b458-4594-b816-bf8966ca6e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:39.867214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-3a0e02ed-eefc-4036-8cf5-5d6cde0d4837 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:39.867624 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a4ab-b458-4594-b816-bf8966ca6e08 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:39.867903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a4ab-b458-4594-b816-bf8966ca6e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:39.868176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a4ab-b458-4594-b816-bf8966ca6e08 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:39.868378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-3a0e02ed-eefc-4036-8cf5-5d6cde0d4837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:39.868906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6a4ab-b458-4594-b816-bf8966ca6e08 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:39.870738 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6a4ab-b458-4594-b816-bf8966ca6e08 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:39.876525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 417/835] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:39 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:39.902182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e02ed-eefc-4036-8cf5-5d6cde0d4837 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:39.911928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e02ed-eefc-4036-8cf5-5d6cde0d4837 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:39.916482 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121db9a-d825-4f5b-b770-c881811cd98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:39.917310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121db9a-d825-4f5b-b770-c881811cd98e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:39.917581 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121db9a-d825-4f5b-b770-c881811cd98e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:39.917845 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121db9a-d825-4f5b-b770-c881811cd98e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:39.928179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121db9a-d825-4f5b-b770-c881811cd98e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:39.935520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-d121db9a-d825-4f5b-b770-c881811cd98e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 14:18:39.936780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 418/836] 10.222.0.16 () {56 vars in 1142 bytes} [Sun Aug 29 14:18:39 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:39.943741 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121db9a-d825-4f5b-b770-c881811cd98e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:39.954107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121db9a-d825-4f5b-b770-c881811cd98e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:39.966236 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 419/837] 10.222.0.16 () {60 vars in 1166 bytes} [Sun Aug 29 14:18:39 2021] POST /identity/v3/endpoints => generated 346 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:39.972941 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce906833-0a1e-4db0-ae2c-b22a5ad751f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:39.974058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce906833-0a1e-4db0-ae2c-b22a5ad751f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:39.974529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce906833-0a1e-4db0-ae2c-b22a5ad751f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:39.981590 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce906833-0a1e-4db0-ae2c-b22a5ad751f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:39.981590 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce906833-0a1e-4db0-ae2c-b22a5ad751f0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:39.981590 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce906833-0a1e-4db0-ae2c-b22a5ad751f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:39.981590 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce906833-0a1e-4db0-ae2c-b22a5ad751f0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:39.989107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 419/838] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Aug 29 14:18:39 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:39.996078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6a4ab-b458-4594-b816-bf8966ca6e08 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.021691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6a4ab-b458-4594-b816-bf8966ca6e08 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.027024 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23620e-8fd6-4f14-93f4-29ace2c367e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.028220 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23620e-8fd6-4f14-93f4-29ace2c367e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.028771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23620e-8fd6-4f14-93f4-29ace2c367e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.029291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23620e-8fd6-4f14-93f4-29ace2c367e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.042035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23620e-8fd6-4f14-93f4-29ace2c367e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.044336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23620e-8fd6-4f14-93f4-29ace2c367e7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.063744 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-1e23620e-8fd6-4f14-93f4-29ace2c367e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:40.066705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 420/839] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:40.073435 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce906833-0a1e-4db0-ae2c-b22a5ad751f0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.084503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce906833-0a1e-4db0-ae2c-b22a5ad751f0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.089569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ee922-d9e9-4d1f-9dcc-cfc0634173e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.090761 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ee922-d9e9-4d1f-9dcc-cfc0634173e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.091291 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ee922-d9e9-4d1f-9dcc-cfc0634173e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.091780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ee922-d9e9-4d1f-9dcc-cfc0634173e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.092709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ee922-d9e9-4d1f-9dcc-cfc0634173e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:40.093209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ee922-d9e9-4d1f-9dcc-cfc0634173e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.095120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ee922-d9e9-4d1f-9dcc-cfc0634173e1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.108498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 420/840] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:40.115982 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23620e-8fd6-4f14-93f4-29ace2c367e7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.126631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23620e-8fd6-4f14-93f4-29ace2c367e7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.132090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d215946-eb4f-4c30-9632-766854a204be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.133521 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d215946-eb4f-4c30-9632-766854a204be admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.134120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d215946-eb4f-4c30-9632-766854a204be admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.134823 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d215946-eb4f-4c30-9632-766854a204be admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.144369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d215946-eb4f-4c30-9632-766854a204be admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.146747 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d215946-eb4f-4c30-9632-766854a204be admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.163285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-1d215946-eb4f-4c30-9632-766854a204be admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 14:18:40.165103 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 421/841] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:40.171619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ee922-d9e9-4d1f-9dcc-cfc0634173e1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.183282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ee922-d9e9-4d1f-9dcc-cfc0634173e1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.188088 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c92686-5b8e-4985-bfd3-c69921f2c667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.188994 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c92686-5b8e-4985-bfd3-c69921f2c667 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.189483 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c92686-5b8e-4985-bfd3-c69921f2c667 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.190020 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c92686-5b8e-4985-bfd3-c69921f2c667 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.191202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c92686-5b8e-4985-bfd3-c69921f2c667 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:40.191703 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c92686-5b8e-4985-bfd3-c69921f2c667 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.193748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c92686-5b8e-4985-bfd3-c69921f2c667 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.212145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 421/842] 10.222.0.16 () {56 vars in 1171 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:40.218683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d215946-eb4f-4c30-9632-766854a204be admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.229490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d215946-eb4f-4c30-9632-766854a204be admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.234427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69fab-0497-40a3-9070-a812390489d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.235332 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69fab-0497-40a3-9070-a812390489d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.235832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69fab-0497-40a3-9070-a812390489d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.236305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69fab-0497-40a3-9070-a812390489d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.245402 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a69fab-0497-40a3-9070-a812390489d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.247394 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a69fab-0497-40a3-9070-a812390489d6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.257180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 422/843] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/auth/tokens => generated 2291 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:40.264061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c92686-5b8e-4985-bfd3-c69921f2c667 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.274696 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c92686-5b8e-4985-bfd3-c69921f2c667 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.279545 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a64302-d97a-4f97-870c-3d8b54e088fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.280619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a64302-d97a-4f97-870c-3d8b54e088fc admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.281091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a64302-d97a-4f97-870c-3d8b54e088fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.281575 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a64302-d97a-4f97-870c-3d8b54e088fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.292829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a64302-d97a-4f97-870c-3d8b54e088fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.295061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a64302-d97a-4f97-870c-3d8b54e088fc admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.312491 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-38a64302-d97a-4f97-870c-3d8b54e088fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:40.314230 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 422/844] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:40.321007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69fab-0497-40a3-9070-a812390489d6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.330918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69fab-0497-40a3-9070-a812390489d6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.336035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267af29-14fa-4be5-b1e1-541cc9ce0863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.336909 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267af29-14fa-4be5-b1e1-541cc9ce0863 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.337425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267af29-14fa-4be5-b1e1-541cc9ce0863 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.337939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267af29-14fa-4be5-b1e1-541cc9ce0863 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.338903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267af29-14fa-4be5-b1e1-541cc9ce0863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:40.339398 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267af29-14fa-4be5-b1e1-541cc9ce0863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.341157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267af29-14fa-4be5-b1e1-541cc9ce0863 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.354487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 423/845] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:40.361034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a64302-d97a-4f97-870c-3d8b54e088fc admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.371517 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a64302-d97a-4f97-870c-3d8b54e088fc admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.376369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f79838-f75e-4b81-89bb-55a39c3f2301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.377414 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f79838-f75e-4b81-89bb-55a39c3f2301 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.378043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f79838-f75e-4b81-89bb-55a39c3f2301 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.378606 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f79838-f75e-4b81-89bb-55a39c3f2301 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.386128 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f79838-f75e-4b81-89bb-55a39c3f2301 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.388344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f79838-f75e-4b81-89bb-55a39c3f2301 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.402234 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-e7f79838-f75e-4b81-89bb-55a39c3f2301 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:40.403976 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 423/846] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:40.411197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267af29-14fa-4be5-b1e1-541cc9ce0863 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.421184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267af29-14fa-4be5-b1e1-541cc9ce0863 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.426113 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49657861-c8e1-4e90-a46f-a7453607363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.427058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49657861-c8e1-4e90-a46f-a7453607363f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.427525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49657861-c8e1-4e90-a46f-a7453607363f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.427967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49657861-c8e1-4e90-a46f-a7453607363f admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.428901 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49657861-c8e1-4e90-a46f-a7453607363f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:40.429372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49657861-c8e1-4e90-a46f-a7453607363f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.431441 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49657861-c8e1-4e90-a46f-a7453607363f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.446436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 424/847] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:40.453229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f79838-f75e-4b81-89bb-55a39c3f2301 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.464353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f79838-f75e-4b81-89bb-55a39c3f2301 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.469111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4def36-bd3c-455e-8069-3a1e5e5f2033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.470045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4def36-bd3c-455e-8069-3a1e5e5f2033 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.470532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4def36-bd3c-455e-8069-3a1e5e5f2033 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.471037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4def36-bd3c-455e-8069-3a1e5e5f2033 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.472565 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4def36-bd3c-455e-8069-3a1e5e5f2033 admin admin] RBAC: Adding query filter params (role.id=e1eed6eb3c344f43bd3ea8c3751a272f, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=afee50dd81e5484081d4aef1c119a129) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:40.473194 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4def36-bd3c-455e-8069-3a1e5e5f2033 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.475239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4def36-bd3c-455e-8069-3a1e5e5f2033 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.481836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 424/848] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/role_assignments?user.id=afee50dd81e5484081d4aef1c119a129&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=e1eed6eb3c344f43bd3ea8c3751a272f => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:40.645828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27357bc2-0e25-429f-b3fd-98a5ff178c94 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.646351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27357bc2-0e25-429f-b3fd-98a5ff178c94 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.646765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27357bc2-0e25-429f-b3fd-98a5ff178c94 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.648912 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 425/849] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:40.656768 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77badc-ead8-4d89-b5ff-688c3e216795 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.657174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77badc-ead8-4d89-b5ff-688c3e216795 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.657546 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77badc-ead8-4d89-b5ff-688c3e216795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.678122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-3e77badc-ead8-4d89-b5ff-688c3e216795 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:40.679450 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-3e77badc-ead8-4d89-b5ff-688c3e216795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:40.687566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 425/850] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:40 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:40.713123 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27357bc2-0e25-429f-b3fd-98a5ff178c94 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.726480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27357bc2-0e25-429f-b3fd-98a5ff178c94 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.731131 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd545e-3ddf-4ee9-bf79-d3b7367af351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.732009 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd545e-3ddf-4ee9-bf79-d3b7367af351 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.732286 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd545e-3ddf-4ee9-bf79-d3b7367af351 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.732552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd545e-3ddf-4ee9-bf79-d3b7367af351 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.733246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd545e-3ddf-4ee9-bf79-d3b7367af351 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.734972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd545e-3ddf-4ee9-bf79-d3b7367af351 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.747066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-c0fd545e-3ddf-4ee9-bf79-d3b7367af351 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 14:18:40.748561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 426/851] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:40.755965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77badc-ead8-4d89-b5ff-688c3e216795 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.765387 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77badc-ead8-4d89-b5ff-688c3e216795 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.770894 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a7f0-3e37-417f-a59f-91c2cb9efcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.771612 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a7f0-3e37-417f-a59f-91c2cb9efcfc admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.771890 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a7f0-3e37-417f-a59f-91c2cb9efcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.772214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a7f0-3e37-417f-a59f-91c2cb9efcfc admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.772984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944a7f0-3e37-417f-a59f-91c2cb9efcfc admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:40.773277 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944a7f0-3e37-417f-a59f-91c2cb9efcfc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.774958 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944a7f0-3e37-417f-a59f-91c2cb9efcfc admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.780214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 426/852] 10.222.0.16 () {56 vars in 1144 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:40.786473 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd545e-3ddf-4ee9-bf79-d3b7367af351 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.796479 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd545e-3ddf-4ee9-bf79-d3b7367af351 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.801203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ecc3a-e59e-4d58-9948-66053e2f15b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.801958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ecc3a-e59e-4d58-9948-66053e2f15b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.802244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ecc3a-e59e-4d58-9948-66053e2f15b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.802516 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ecc3a-e59e-4d58-9948-66053e2f15b4 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.803294 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ecc3a-e59e-4d58-9948-66053e2f15b4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:40.803597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ecc3a-e59e-4d58-9948-66053e2f15b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.805299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ecc3a-e59e-4d58-9948-66053e2f15b4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.811607 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 427/853] 10.222.0.16 () {56 vars in 1144 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:40.819159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a7f0-3e37-417f-a59f-91c2cb9efcfc admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.829729 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a7f0-3e37-417f-a59f-91c2cb9efcfc admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.835330 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c5654-eb97-4bfe-be20-43eb3ae2142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.836005 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c5654-eb97-4bfe-be20-43eb3ae2142d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.836285 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c5654-eb97-4bfe-be20-43eb3ae2142d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.836558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c5654-eb97-4bfe-be20-43eb3ae2142d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.837365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c5654-eb97-4bfe-be20-43eb3ae2142d admin admin] RBAC: Adding query filter params (interface=public, service_id=9bdfc9d18cee4cdc8740643fbdc19d48, region_id=RegionOne) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:40.837675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c5654-eb97-4bfe-be20-43eb3ae2142d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.839319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c5654-eb97-4bfe-be20-43eb3ae2142d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.845478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 427/854] 10.222.0.16 () {56 vars in 1273 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/endpoints?service_id=9bdfc9d18cee4cdc8740643fbdc19d48&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:40.852275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ecc3a-e59e-4d58-9948-66053e2f15b4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.862470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ecc3a-e59e-4d58-9948-66053e2f15b4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.867150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162e5aa-8e8b-4aa3-bafb-2b9d3c17a3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.867865 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162e5aa-8e8b-4aa3-bafb-2b9d3c17a3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.868145 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162e5aa-8e8b-4aa3-bafb-2b9d3c17a3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.868416 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162e5aa-8e8b-4aa3-bafb-2b9d3c17a3f2 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.869135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162e5aa-8e8b-4aa3-bafb-2b9d3c17a3f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.870812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162e5aa-8e8b-4aa3-bafb-2b9d3c17a3f2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:40.877027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 428/855] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/services => generated 1497 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:18:40.900493 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f300c-7520-4a67-b51f-9fe32407ad7d None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.900779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f300c-7520-4a67-b51f-9fe32407ad7d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.901056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f300c-7520-4a67-b51f-9fe32407ad7d None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.903425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 428/856] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:40.911493 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dc438-9f04-4c40-9e23-ed0ab237c2f9 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.913242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dc438-9f04-4c40-9e23-ed0ab237c2f9 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.913589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dc438-9f04-4c40-9e23-ed0ab237c2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.935324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3e6dc438-9f04-4c40-9e23-ed0ab237c2f9 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:40.936742 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3e6dc438-9f04-4c40-9e23-ed0ab237c2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:40.945400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 429/857] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:40 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:40.970736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f300c-7520-4a67-b51f-9fe32407ad7d None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:40.982547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f300c-7520-4a67-b51f-9fe32407ad7d None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:40.987531 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472ae65-9d03-49b4-9ff4-55edda17518e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:40.988390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472ae65-9d03-49b4-9ff4-55edda17518e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:40.988670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472ae65-9d03-49b4-9ff4-55edda17518e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:40.988991 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472ae65-9d03-49b4-9ff4-55edda17518e admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:40.989650 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472ae65-9d03-49b4-9ff4-55edda17518e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:40.991380 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472ae65-9d03-49b4-9ff4-55edda17518e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:41.004180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-1472ae65-9d03-49b4-9ff4-55edda17518e admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 14:18:41.005769 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 429/858] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:40 2021] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:41.012876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dc438-9f04-4c40-9e23-ed0ab237c2f9 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:41.023431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dc438-9f04-4c40-9e23-ed0ab237c2f9 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:41.028319 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b41ec-1073-40e8-bb71-8233dae1c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:41.029052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b41ec-1073-40e8-bb71-8233dae1c936 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:41.029334 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b41ec-1073-40e8-bb71-8233dae1c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:41.029610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b41ec-1073-40e8-bb71-8233dae1c936 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:41.030412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b41ec-1073-40e8-bb71-8233dae1c936 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:41.030718 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b41ec-1073-40e8-bb71-8233dae1c936 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:41.032407 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b41ec-1073-40e8-bb71-8233dae1c936 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:41.038709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 430/859] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:41 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:41.045021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472ae65-9d03-49b4-9ff4-55edda17518e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:41.055869 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472ae65-9d03-49b4-9ff4-55edda17518e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:41.061033 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb0d54-1aee-4cb6-9b8c-8988be4fbea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:41.061717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb0d54-1aee-4cb6-9b8c-8988be4fbea7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:41.062028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb0d54-1aee-4cb6-9b8c-8988be4fbea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:41.062306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb0d54-1aee-4cb6-9b8c-8988be4fbea7 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:41.063010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb0d54-1aee-4cb6-9b8c-8988be4fbea7 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:41.063317 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb0d54-1aee-4cb6-9b8c-8988be4fbea7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:41.064970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb0d54-1aee-4cb6-9b8c-8988be4fbea7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:41.070241 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 430/860] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:41 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:42.264268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670ba90-485f-4734-961e-6d81cf1a90fc None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:42.264888 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670ba90-485f-4734-961e-6d81cf1a90fc None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:42.264888 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670ba90-485f-4734-961e-6d81cf1a90fc None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:42.266955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 431/861] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:42.273244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdaa47-12b7-40fc-8993-3db97f52e919 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:42.273746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdaa47-12b7-40fc-8993-3db97f52e919 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:42.273921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdaa47-12b7-40fc-8993-3db97f52e919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:42.291832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-54bdaa47-12b7-40fc-8993-3db97f52e919 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:42.293023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-54bdaa47-12b7-40fc-8993-3db97f52e919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:42.305967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 431/862] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:42 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:42.326324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670ba90-485f-4734-961e-6d81cf1a90fc None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:42.339649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670ba90-485f-4734-961e-6d81cf1a90fc None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:42.344179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f397-cc91-4306-b937-4532e98d0e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:42.344825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f397-cc91-4306-b937-4532e98d0e96 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:42.345105 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f397-cc91-4306-b937-4532e98d0e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:42.345380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f397-cc91-4306-b937-4532e98d0e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:42.346157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04f397-cc91-4306-b937-4532e98d0e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:42.348056 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04f397-cc91-4306-b937-4532e98d0e96 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:42.349417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.common [None req-ee04f397-cc91-4306-b937-4532e98d0e96 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 14:18:42.420764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.sql.core [None req-ee04f397-cc91-4306-b937-4532e98d0e96 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 14:18:42.420764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 14:18:42.420764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [parameters: {'id': '7a61982cda2847f2b4090c95f5039f79', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 14:18:42.420764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73673) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 14:18:42.436981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-ee04f397-cc91-4306-b937-4532e98d0e96 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7a61982cda2847f2b4090c95f5039f79.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7a61982cda2847f2b4090c95f5039f79. Aug 29 14:18:42.444393 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 432/863] 10.222.0.16 () {60 vars in 1162 bytes} [Sun Aug 29 14:18:42 2021] POST /identity/v3/projects => generated 262 bytes in 113 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:42.445728 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdaa47-12b7-40fc-8993-3db97f52e919 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:42.455732 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdaa47-12b7-40fc-8993-3db97f52e919 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:42.460520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151eae81-fd69-4b6b-b94e-c035f0139105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:42.461302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eae81-fd69-4b6b-b94e-c035f0139105 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:42.461637 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eae81-fd69-4b6b-b94e-c035f0139105 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:42.461947 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eae81-fd69-4b6b-b94e-c035f0139105 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:42.469338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151eae81-fd69-4b6b-b94e-c035f0139105 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:42.471929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151eae81-fd69-4b6b-b94e-c035f0139105 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:42.485179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-151eae81-fd69-4b6b-b94e-c035f0139105 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:42.491378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 432/864] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:42.494037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f397-cc91-4306-b937-4532e98d0e96 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:42.506088 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f397-cc91-4306-b937-4532e98d0e96 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:42.511042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56f2ba-ac92-42b6-b1a1-4c1ced31958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:42.511688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f2ba-ac92-42b6-b1a1-4c1ced31958c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:42.511971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f2ba-ac92-42b6-b1a1-4c1ced31958c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:42.512244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f2ba-ac92-42b6-b1a1-4c1ced31958c admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:42.513057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56f2ba-ac92-42b6-b1a1-4c1ced31958c admin admin] RBAC: Adding query filter params (name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:42.513425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56f2ba-ac92-42b6-b1a1-4c1ced31958c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:42.515750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56f2ba-ac92-42b6-b1a1-4c1ced31958c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:42.545178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 433/865] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:42 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:42.772375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977658c-ebb0-411a-86c1-4769a6224ddc None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:42.772736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977658c-ebb0-411a-86c1-4769a6224ddc None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:42.772914 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977658c-ebb0-411a-86c1-4769a6224ddc None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:42.774958 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 433/866] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:42.781037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f7003-8d6c-43e1-b308-6ad1d6fc5bdd None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:42.781329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f7003-8d6c-43e1-b308-6ad1d6fc5bdd None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:42.781584 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f7003-8d6c-43e1-b308-6ad1d6fc5bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:42.800580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-f79f7003-8d6c-43e1-b308-6ad1d6fc5bdd None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:42.802111 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f79f7003-8d6c-43e1-b308-6ad1d6fc5bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:42.810114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 434/867] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:42 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:42.834160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977658c-ebb0-411a-86c1-4769a6224ddc None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:42.847603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977658c-ebb0-411a-86c1-4769a6224ddc None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:42.852026 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65853b-05b8-4ccc-9295-49c574864431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:42.852806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65853b-05b8-4ccc-9295-49c574864431 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:42.853081 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65853b-05b8-4ccc-9295-49c574864431 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:42.853349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65853b-05b8-4ccc-9295-49c574864431 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:42.854017 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65853b-05b8-4ccc-9295-49c574864431 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:42.855586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65853b-05b8-4ccc-9295-49c574864431 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:42.866674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-bc65853b-05b8-4ccc-9295-49c574864431 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 14:18:42.868167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 434/868] 10.222.0.16 () {56 vars in 1127 bytes} [Sun Aug 29 14:18:42 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:42.874691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f7003-8d6c-43e1-b308-6ad1d6fc5bdd None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:42.884668 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f7003-8d6c-43e1-b308-6ad1d6fc5bdd None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:42.889337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebed8a-eba6-45c9-8563-adea04567082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:42.890039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebed8a-eba6-45c9-8563-adea04567082 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:42.890319 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebed8a-eba6-45c9-8563-adea04567082 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:42.890594 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebed8a-eba6-45c9-8563-adea04567082 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:42.891309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebed8a-eba6-45c9-8563-adea04567082 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:42.891612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebed8a-eba6-45c9-8563-adea04567082 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:42.894015 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebed8a-eba6-45c9-8563-adea04567082 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:42.899551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 435/869] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:42 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:42.905685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65853b-05b8-4ccc-9295-49c574864431 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:42.915587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65853b-05b8-4ccc-9295-49c574864431 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:42.920203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978f8f6-b3c5-485d-a71b-9e1e92ca39d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:42.920848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978f8f6-b3c5-485d-a71b-9e1e92ca39d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:42.921173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978f8f6-b3c5-485d-a71b-9e1e92ca39d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:42.921449 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978f8f6-b3c5-485d-a71b-9e1e92ca39d9 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:42.922232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978f8f6-b3c5-485d-a71b-9e1e92ca39d9 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:42.922537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978f8f6-b3c5-485d-a71b-9e1e92ca39d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:42.924476 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978f8f6-b3c5-485d-a71b-9e1e92ca39d9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:42.930724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 435/870] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:42 2021] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:43.152818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b10264-4697-4438-8c80-3acbd3b3039f None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:43.153158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b10264-4697-4438-8c80-3acbd3b3039f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:43.153333 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b10264-4697-4438-8c80-3acbd3b3039f None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:43.155326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 436/871] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:43.161801 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00f59-9581-4c23-9f41-b71f2a0dcdee None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:43.162130 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00f59-9581-4c23-9f41-b71f2a0dcdee None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:43.162493 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00f59-9581-4c23-9f41-b71f2a0dcdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:43.181754 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-1cf00f59-9581-4c23-9f41-b71f2a0dcdee None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:43.183377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1cf00f59-9581-4c23-9f41-b71f2a0dcdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:43.192834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 436/872] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:43 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:43.217743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b10264-4697-4438-8c80-3acbd3b3039f None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:43.230281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b10264-4697-4438-8c80-3acbd3b3039f None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:43.234763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad59f8-ee1c-48e8-b408-635ddab01f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:43.235561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad59f8-ee1c-48e8-b408-635ddab01f22 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:43.235843 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad59f8-ee1c-48e8-b408-635ddab01f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:43.236118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad59f8-ee1c-48e8-b408-635ddab01f22 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:43.236800 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad59f8-ee1c-48e8-b408-635ddab01f22 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:43.238494 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad59f8-ee1c-48e8-b408-635ddab01f22 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:43.249895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-23ad59f8-ee1c-48e8-b408-635ddab01f22 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 14:18:43.257351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 437/873] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Aug 29 14:18:43 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:43.258963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00f59-9581-4c23-9f41-b71f2a0dcdee None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:43.266637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f3ba-1d3b-4323-b0f6-6a9b0c529188 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:43.267085 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f3ba-1d3b-4323-b0f6-6a9b0c529188 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:43.267229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f3ba-1d3b-4323-b0f6-6a9b0c529188 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:43.268858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00f59-9581-4c23-9f41-b71f2a0dcdee None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:43.269792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 438/874] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:43.273620 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d799615-b497-403a-985e-6b912d5aba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:43.274589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d799615-b497-403a-985e-6b912d5aba8e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:43.274939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d799615-b497-403a-985e-6b912d5aba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:43.275279 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d799615-b497-403a-985e-6b912d5aba8e admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:43.276062 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d799615-b497-403a-985e-6b912d5aba8e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:43.276351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08895d3a-50a5-4e03-8a3a-756eaf398a61 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:43.276451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d799615-b497-403a-985e-6b912d5aba8e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:43.276884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08895d3a-50a5-4e03-8a3a-756eaf398a61 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:43.277341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08895d3a-50a5-4e03-8a3a-756eaf398a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:43.278220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d799615-b497-403a-985e-6b912d5aba8e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:43.288715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 437/875] 10.222.0.16 () {56 vars in 1144 bytes} [Sun Aug 29 14:18:43 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:43.290276 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d799615-b497-403a-985e-6b912d5aba8e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:43.300917 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d799615-b497-403a-985e-6b912d5aba8e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:43.302898 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-08895d3a-50a5-4e03-8a3a-756eaf398a61 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:43.304226 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-08895d3a-50a5-4e03-8a3a-756eaf398a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:43.305779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487419b-a8a8-456a-b946-b8e2e6008aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:43.306630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487419b-a8a8-456a-b946-b8e2e6008aad admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:43.307002 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487419b-a8a8-456a-b946-b8e2e6008aad admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:43.307415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487419b-a8a8-456a-b946-b8e2e6008aad admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:43.308212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487419b-a8a8-456a-b946-b8e2e6008aad admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:43.308648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487419b-a8a8-456a-b946-b8e2e6008aad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:43.310647 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487419b-a8a8-456a-b946-b8e2e6008aad admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:43.313653 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 439/876] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:43 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:43.321972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 438/877] 10.222.0.16 () {56 vars in 1144 bytes} [Sun Aug 29 14:18:43 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:43.327110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08895d3a-50a5-4e03-8a3a-756eaf398a61 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:43.337620 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487419b-a8a8-456a-b946-b8e2e6008aad admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:43.338260 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08895d3a-50a5-4e03-8a3a-756eaf398a61 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:43.343120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f4667-955b-4e28-bb9d-56002c7ed318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:43.343782 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f4667-955b-4e28-bb9d-56002c7ed318 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:43.344063 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f4667-955b-4e28-bb9d-56002c7ed318 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:43.344338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f4667-955b-4e28-bb9d-56002c7ed318 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:43.345122 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f4667-955b-4e28-bb9d-56002c7ed318 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:43.346918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f4667-955b-4e28-bb9d-56002c7ed318 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:43.348958 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487419b-a8a8-456a-b946-b8e2e6008aad admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:43.354647 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c3de2-e981-45e7-a856-2d93c8f1f27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:43.356002 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3de2-e981-45e7-a856-2d93c8f1f27d admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:43.356721 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3de2-e981-45e7-a856-2d93c8f1f27d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:43.357198 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3de2-e981-45e7-a856-2d93c8f1f27d admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:43.358233 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c3de2-e981-45e7-a856-2d93c8f1f27d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:43.360158 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c3de2-e981-45e7-a856-2d93c8f1f27d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:43.426023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 440/878] 10.222.0.16 () {60 vars in 1166 bytes} [Sun Aug 29 14:18:43 2021] POST /identity/v3/endpoints => generated 349 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:43.450195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 439/879] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:18:43 2021] POST /identity/v3/services => generated 242 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:18:44.825336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb7bcf-a0e8-481f-b55b-a7aab94c762a None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:44.825849 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb7bcf-a0e8-481f-b55b-a7aab94c762a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:44.825955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb7bcf-a0e8-481f-b55b-a7aab94c762a None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:44.827968 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 441/880] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:44.834787 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9547a2c-b4b0-472e-9bd4-dfaca7d5fba8 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:44.835177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9547a2c-b4b0-472e-9bd4-dfaca7d5fba8 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:44.835358 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9547a2c-b4b0-472e-9bd4-dfaca7d5fba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:44.853650 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-a9547a2c-b4b0-472e-9bd4-dfaca7d5fba8 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:44.854869 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a9547a2c-b4b0-472e-9bd4-dfaca7d5fba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:44.872060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 440/881] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:44 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:44.898619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb7bcf-a0e8-481f-b55b-a7aab94c762a None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:44.912223 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb7bcf-a0e8-481f-b55b-a7aab94c762a None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:44.916697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c7e94-5db5-4f32-af52-222d7fcc950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:44.917362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c7e94-5db5-4f32-af52-222d7fcc950a admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:44.917643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c7e94-5db5-4f32-af52-222d7fcc950a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:44.917939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c7e94-5db5-4f32-af52-222d7fcc950a admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:44.918643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c7e94-5db5-4f32-af52-222d7fcc950a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:44.920484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c7e94-5db5-4f32-af52-222d7fcc950a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.012457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.sql.core [None req-639c7e94-5db5-4f32-af52-222d7fcc950a admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 14:18:45.012457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 14:18:45.012457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [parameters: {'user_id': '77b10784f38e4d5c8c09fe9f6fa10a3d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 14:18:45.012457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73673) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 14:18:45.015528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-639c7e94-5db5-4f32-af52-222d7fcc950a admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 14:18:45.017158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 442/882] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:18:44 2021] POST /identity/v3/users => generated 160 bytes in 119 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:45.024417 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9547a2c-b4b0-472e-9bd4-dfaca7d5fba8 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.034344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9547a2c-b4b0-472e-9bd4-dfaca7d5fba8 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.039151 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a859f1-a5e6-4801-ae09-ac211f9e20cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.039960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a859f1-a5e6-4801-ae09-ac211f9e20cc admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.040240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a859f1-a5e6-4801-ae09-ac211f9e20cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.040515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a859f1-a5e6-4801-ae09-ac211f9e20cc admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.048546 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a859f1-a5e6-4801-ae09-ac211f9e20cc admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.050694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a859f1-a5e6-4801-ae09-ac211f9e20cc admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.066212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-18a859f1-a5e6-4801-ae09-ac211f9e20cc admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 14:18:45.067834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 441/883] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:45 2021] GET /identity/v3/users/cinder => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:45.074789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c7e94-5db5-4f32-af52-222d7fcc950a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.090225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c7e94-5db5-4f32-af52-222d7fcc950a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.095114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176c5b1-f16f-41d1-93ee-a45bd95e8e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.096390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176c5b1-f16f-41d1-93ee-a45bd95e8e94 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.096841 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176c5b1-f16f-41d1-93ee-a45bd95e8e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.096841 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176c5b1-f16f-41d1-93ee-a45bd95e8e94 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.098096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176c5b1-f16f-41d1-93ee-a45bd95e8e94 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:45.098403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176c5b1-f16f-41d1-93ee-a45bd95e8e94 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.100575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176c5b1-f16f-41d1-93ee-a45bd95e8e94 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.140263 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 443/884] 10.222.0.16 () {56 vars in 1123 bytes} [Sun Aug 29 14:18:45 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:45.150761 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2ff5-b8df-4591-8d80-1f6ab3c3fb63 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.151160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2ff5-b8df-4591-8d80-1f6ab3c3fb63 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.151502 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2ff5-b8df-4591-8d80-1f6ab3c3fb63 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.153780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 442/885] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:45.161140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d152787-b13c-438d-9002-dd37f3e93e0c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.161501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d152787-b13c-438d-9002-dd37f3e93e0c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.161843 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d152787-b13c-438d-9002-dd37f3e93e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.181784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0d152787-b13c-438d-9002-dd37f3e93e0c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:45.183403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0d152787-b13c-438d-9002-dd37f3e93e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:45.192464 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 444/886] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:45 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:45.217091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa2ff5-b8df-4591-8d80-1f6ab3c3fb63 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.231045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa2ff5-b8df-4591-8d80-1f6ab3c3fb63 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.235817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f894f-8531-4814-b3f2-81e8388a0f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.237375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f894f-8531-4814-b3f2-81e8388a0f8d admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.237967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f894f-8531-4814-b3f2-81e8388a0f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.237967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f894f-8531-4814-b3f2-81e8388a0f8d admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.238802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f894f-8531-4814-b3f2-81e8388a0f8d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.240539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f894f-8531-4814-b3f2-81e8388a0f8d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.324747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 443/887] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:18:45 2021] POST /identity/v3/services => generated 242 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:45.672640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772ae05-accf-4520-8027-342ad330553a None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.673045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772ae05-accf-4520-8027-342ad330553a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.673218 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772ae05-accf-4520-8027-342ad330553a None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.675665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 445/888] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:45.682207 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58541b-6566-45af-ac19-48b5026c5b0e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.682505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58541b-6566-45af-ac19-48b5026c5b0e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.682777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58541b-6566-45af-ac19-48b5026c5b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.701091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-5b58541b-6566-45af-ac19-48b5026c5b0e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:45.702355 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5b58541b-6566-45af-ac19-48b5026c5b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:45.718871 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 444/889] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:45 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:45.742348 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2e6f8-5d3d-4505-9b49-bf9a97275b67 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.742629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2e6f8-5d3d-4505-9b49-bf9a97275b67 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.742798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58541b-6566-45af-ac19-48b5026c5b0e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.742962 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2e6f8-5d3d-4505-9b49-bf9a97275b67 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.744646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 446/890] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:45.750464 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa28fe-6126-4bbb-8fcc-43252d44f932 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.750755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa28fe-6126-4bbb-8fcc-43252d44f932 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.751040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa28fe-6126-4bbb-8fcc-43252d44f932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.751693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58541b-6566-45af-ac19-48b5026c5b0e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.756802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee5138-42c8-4c5e-a139-3d457da98780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.757582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee5138-42c8-4c5e-a139-3d457da98780 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.758140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee5138-42c8-4c5e-a139-3d457da98780 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.758416 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee5138-42c8-4c5e-a139-3d457da98780 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.759070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee5138-42c8-4c5e-a139-3d457da98780 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.760662 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee5138-42c8-4c5e-a139-3d457da98780 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.770524 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b2aa28fe-6126-4bbb-8fcc-43252d44f932 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:45.771708 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b2aa28fe-6126-4bbb-8fcc-43252d44f932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:45.772117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-58ee5138-42c8-4c5e-a139-3d457da98780 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 14:18:45.778769 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 445/891] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:45 2021] GET /identity/v3/services/compute => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:45.779626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee5138-42c8-4c5e-a139-3d457da98780 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.785770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 447/892] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:45 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:45.789774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee5138-42c8-4c5e-a139-3d457da98780 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.794332 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e897202-9beb-4a25-b0cc-6495fd1c4d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.794963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e897202-9beb-4a25-b0cc-6495fd1c4d3f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.795243 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e897202-9beb-4a25-b0cc-6495fd1c4d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.795518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e897202-9beb-4a25-b0cc-6495fd1c4d3f admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.796216 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e897202-9beb-4a25-b0cc-6495fd1c4d3f admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:45.796524 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e897202-9beb-4a25-b0cc-6495fd1c4d3f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.798091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e897202-9beb-4a25-b0cc-6495fd1c4d3f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.803190 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 446/893] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:45 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:45.809366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa28fe-6126-4bbb-8fcc-43252d44f932 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.810513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e897202-9beb-4a25-b0cc-6495fd1c4d3f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.818788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa28fe-6126-4bbb-8fcc-43252d44f932 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.820343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e897202-9beb-4a25-b0cc-6495fd1c4d3f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.823372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b0b78-2897-4545-abe4-c4d6b1a296cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.824002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b0b78-2897-4545-abe4-c4d6b1a296cb admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.824290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b0b78-2897-4545-abe4-c4d6b1a296cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.824566 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b0b78-2897-4545-abe4-c4d6b1a296cb admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.824973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462fbd6-91a9-45ce-8681-ae0df542f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.825279 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b0b78-2897-4545-abe4-c4d6b1a296cb admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:45.825565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b0b78-2897-4545-abe4-c4d6b1a296cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.826173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462fbd6-91a9-45ce-8681-ae0df542f6ee admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.826173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462fbd6-91a9-45ce-8681-ae0df542f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.826487 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462fbd6-91a9-45ce-8681-ae0df542f6ee admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.826932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462fbd6-91a9-45ce-8681-ae0df542f6ee admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.827213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b0b78-2897-4545-abe4-c4d6b1a296cb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.828482 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462fbd6-91a9-45ce-8681-ae0df542f6ee admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.837984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 448/894] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:45 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:45.839547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b0b78-2897-4545-abe4-c4d6b1a296cb admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.840794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-6462fbd6-91a9-45ce-8681-ae0df542f6ee admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 14:18:45.841946 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 447/895] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Aug 29 14:18:45 2021] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:45.849532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462fbd6-91a9-45ce-8681-ae0df542f6ee admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.851858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b0b78-2897-4545-abe4-c4d6b1a296cb admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.856349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a935948-48cf-490e-ae8a-578c63c18203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.856978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935948-48cf-490e-ae8a-578c63c18203 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.857264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935948-48cf-490e-ae8a-578c63c18203 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.857533 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935948-48cf-490e-ae8a-578c63c18203 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.858345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a935948-48cf-490e-ae8a-578c63c18203 admin admin] RBAC: Adding query filter params (interface=public, service_id=c8c2e335a5ac4975b8a57d9a768bcfca, region_id=RegionOne) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:45.858657 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a935948-48cf-490e-ae8a-578c63c18203 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.860026 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462fbd6-91a9-45ce-8681-ae0df542f6ee admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.860221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a935948-48cf-490e-ae8a-578c63c18203 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.865255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5ba3d-1d4b-48f6-ad51-ac52c77ff9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.870003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 449/896] 10.222.0.16 () {56 vars in 1273 bytes} [Sun Aug 29 14:18:45 2021] GET /identity/v3/endpoints?service_id=c8c2e335a5ac4975b8a57d9a768bcfca&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:45.870115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5ba3d-1d4b-48f6-ad51-ac52c77ff9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.870115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5ba3d-1d4b-48f6-ad51-ac52c77ff9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.870115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5ba3d-1d4b-48f6-ad51-ac52c77ff9e9 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.870115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5ba3d-1d4b-48f6-ad51-ac52c77ff9e9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:45.870115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5ba3d-1d4b-48f6-ad51-ac52c77ff9e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.870115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5ba3d-1d4b-48f6-ad51-ac52c77ff9e9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.872390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a935948-48cf-490e-ae8a-578c63c18203 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.874810 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 448/897] 10.222.0.16 () {56 vars in 1144 bytes} [Sun Aug 29 14:18:45 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:45.880951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5ba3d-1d4b-48f6-ad51-ac52c77ff9e9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.882360 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a935948-48cf-490e-ae8a-578c63c18203 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.887039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a6dbb-c548-40e5-a4e2-f10ea4fa2754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.887669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a6dbb-c548-40e5-a4e2-f10ea4fa2754 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.887942 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a6dbb-c548-40e5-a4e2-f10ea4fa2754 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.888212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a6dbb-c548-40e5-a4e2-f10ea4fa2754 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.888883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a6dbb-c548-40e5-a4e2-f10ea4fa2754 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.890435 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a6dbb-c548-40e5-a4e2-f10ea4fa2754 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.891219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5ba3d-1d4b-48f6-ad51-ac52c77ff9e9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.896622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a00f90-8cb1-4d91-9b64-3c9404ade520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.897246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a00f90-8cb1-4d91-9b64-3c9404ade520 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.897525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a00f90-8cb1-4d91-9b64-3c9404ade520 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.901948 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a00f90-8cb1-4d91-9b64-3c9404ade520 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.902090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 450/898] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Aug 29 14:18:45 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:18:45.902180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a00f90-8cb1-4d91-9b64-3c9404ade520 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:45.902180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a00f90-8cb1-4d91-9b64-3c9404ade520 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.902180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a00f90-8cb1-4d91-9b64-3c9404ade520 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.905540 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 449/899] 10.222.0.16 () {56 vars in 1144 bytes} [Sun Aug 29 14:18:45 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:45.913062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a6dbb-c548-40e5-a4e2-f10ea4fa2754 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.923317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a6dbb-c548-40e5-a4e2-f10ea4fa2754 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.928432 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4ec07-ccb6-4e6a-82a2-7321125858b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.929270 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4ec07-ccb6-4e6a-82a2-7321125858b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.929422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4ec07-ccb6-4e6a-82a2-7321125858b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.929673 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4ec07-ccb6-4e6a-82a2-7321125858b0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.932964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4ec07-ccb6-4e6a-82a2-7321125858b0 admin admin] RBAC: Adding query filter params (interface=admin, service_id=9bdfc9d18cee4cdc8740643fbdc19d48, region_id=RegionOne) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:45.932964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4ec07-ccb6-4e6a-82a2-7321125858b0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.932964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4ec07-ccb6-4e6a-82a2-7321125858b0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.938715 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 451/900] 10.222.0.16 () {56 vars in 1271 bytes} [Sun Aug 29 14:18:45 2021] GET /identity/v3/endpoints?service_id=9bdfc9d18cee4cdc8740643fbdc19d48&interface=admin®ion_id=RegionOne => generated 193 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:45.945829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a00f90-8cb1-4d91-9b64-3c9404ade520 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:45.960157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a00f90-8cb1-4d91-9b64-3c9404ade520 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:45.965159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ef34e-19b0-4f2c-af61-e73a727568a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:45.965946 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ef34e-19b0-4f2c-af61-e73a727568a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:45.966190 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ef34e-19b0-4f2c-af61-e73a727568a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:45.966460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ef34e-19b0-4f2c-af61-e73a727568a7 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:45.967196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ef34e-19b0-4f2c-af61-e73a727568a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:45.968845 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ef34e-19b0-4f2c-af61-e73a727568a7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:45.981916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 450/901] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Aug 29 14:18:45 2021] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:18:47.524870 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9bc7-3e3e-4ca6-b204-1813abab5c44 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:47.525442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9bc7-3e3e-4ca6-b204-1813abab5c44 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:47.525442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9bc7-3e3e-4ca6-b204-1813abab5c44 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:47.527243 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 452/902] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:47.532951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a8a8f-4a71-482e-9736-612a25a0447e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:47.533941 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a8a8f-4a71-482e-9736-612a25a0447e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:47.534173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a8a8f-4a71-482e-9736-612a25a0447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:47.551921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-3d5a8a8f-4a71-482e-9736-612a25a0447e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:47.553164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-3d5a8a8f-4a71-482e-9736-612a25a0447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:47.560603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 451/903] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:47 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:47.584285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9bc7-3e3e-4ca6-b204-1813abab5c44 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:47.596832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9bc7-3e3e-4ca6-b204-1813abab5c44 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:47.601287 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b74127-3472-46c1-a3d3-e86eb0fe6a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:47.602097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b74127-3472-46c1-a3d3-e86eb0fe6a3c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:47.602375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b74127-3472-46c1-a3d3-e86eb0fe6a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:47.602642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b74127-3472-46c1-a3d3-e86eb0fe6a3c admin admin] PATH_INFO: `/v3/services/image` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:47.603282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b74127-3472-46c1-a3d3-e86eb0fe6a3c admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:47.605004 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b74127-3472-46c1-a3d3-e86eb0fe6a3c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:47.616410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-e5b74127-3472-46c1-a3d3-e86eb0fe6a3c admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 14:18:47.617754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 453/904] 10.222.0.16 () {56 vars in 1127 bytes} [Sun Aug 29 14:18:47 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:47.624393 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a8a8f-4a71-482e-9736-612a25a0447e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:47.635766 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a8a8f-4a71-482e-9736-612a25a0447e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:47.640149 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3cb27-8ce7-410a-9e85-84c8038521ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:47.640852 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3cb27-8ce7-410a-9e85-84c8038521ee admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:47.641133 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3cb27-8ce7-410a-9e85-84c8038521ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:47.641403 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3cb27-8ce7-410a-9e85-84c8038521ee admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:47.642126 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3cb27-8ce7-410a-9e85-84c8038521ee admin admin] RBAC: Adding query filter params (name=image) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:47.642585 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3cb27-8ce7-410a-9e85-84c8038521ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:47.644197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3cb27-8ce7-410a-9e85-84c8038521ee admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:47.649104 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 452/905] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:47 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:47.655295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b74127-3472-46c1-a3d3-e86eb0fe6a3c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:47.665580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b74127-3472-46c1-a3d3-e86eb0fe6a3c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:47.670068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd678318-9384-4d7a-a5f5-7c308fa2fd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:47.670733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd678318-9384-4d7a-a5f5-7c308fa2fd5b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:47.671014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd678318-9384-4d7a-a5f5-7c308fa2fd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:47.671286 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd678318-9384-4d7a-a5f5-7c308fa2fd5b admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:47.671985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd678318-9384-4d7a-a5f5-7c308fa2fd5b admin admin] RBAC: Adding query filter params (type=image) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:47.672286 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd678318-9384-4d7a-a5f5-7c308fa2fd5b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:47.674474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd678318-9384-4d7a-a5f5-7c308fa2fd5b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:47.681949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 454/906] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:47 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:47.691467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3cb27-8ce7-410a-9e85-84c8038521ee admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:47.701112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3cb27-8ce7-410a-9e85-84c8038521ee admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:47.705907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9ae60-bcc0-41b7-969d-426aedbd2edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:47.706631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ae60-bcc0-41b7-969d-426aedbd2edf admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:47.707003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ae60-bcc0-41b7-969d-426aedbd2edf admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:47.707284 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ae60-bcc0-41b7-969d-426aedbd2edf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:47.708065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9ae60-bcc0-41b7-969d-426aedbd2edf admin admin] RBAC: Adding query filter params (interface=public, service_id=cbd259c94dd744e9863682cd12509c21, region_id=RegionOne) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:47.708375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9ae60-bcc0-41b7-969d-426aedbd2edf admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:47.709969 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9ae60-bcc0-41b7-969d-426aedbd2edf admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:47.715227 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 453/907] 10.222.0.16 () {56 vars in 1273 bytes} [Sun Aug 29 14:18:47 2021] GET /identity/v3/endpoints?service_id=cbd259c94dd744e9863682cd12509c21&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:47.722234 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd678318-9384-4d7a-a5f5-7c308fa2fd5b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:47.731889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd678318-9384-4d7a-a5f5-7c308fa2fd5b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:47.737105 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624263a1-cc06-43d7-93e3-d1d734af6eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:47.737757 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624263a1-cc06-43d7-93e3-d1d734af6eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:47.738077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624263a1-cc06-43d7-93e3-d1d734af6eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:47.738347 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624263a1-cc06-43d7-93e3-d1d734af6eb5 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:47.739014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624263a1-cc06-43d7-93e3-d1d734af6eb5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:47.740697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624263a1-cc06-43d7-93e3-d1d734af6eb5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:47.748525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 455/908] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Aug 29 14:18:47 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:18:48.067758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e53e92-07a1-4e0a-9c2c-b7c1a2c7711d None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:48.068124 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e53e92-07a1-4e0a-9c2c-b7c1a2c7711d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:48.068306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e53e92-07a1-4e0a-9c2c-b7c1a2c7711d None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:48.070243 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 454/909] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:48.075923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb5bf2-089e-4a70-b2fa-c1bc4b86f1e0 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:48.076214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb5bf2-089e-4a70-b2fa-c1bc4b86f1e0 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:48.076492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb5bf2-089e-4a70-b2fa-c1bc4b86f1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:48.095277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-bceb5bf2-089e-4a70-b2fa-c1bc4b86f1e0 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:48.096693 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-bceb5bf2-089e-4a70-b2fa-c1bc4b86f1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:48.104749 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 456/910] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:48 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:48.129394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e53e92-07a1-4e0a-9c2c-b7c1a2c7711d None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:48.141508 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e53e92-07a1-4e0a-9c2c-b7c1a2c7711d None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:48.146804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28b444-91c6-4b4b-9a0b-0b4d2ca94616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:48.147576 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28b444-91c6-4b4b-9a0b-0b4d2ca94616 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:48.147850 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28b444-91c6-4b4b-9a0b-0b4d2ca94616 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:48.148114 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28b444-91c6-4b4b-9a0b-0b4d2ca94616 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:48.148743 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28b444-91c6-4b4b-9a0b-0b4d2ca94616 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:48.150367 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28b444-91c6-4b4b-9a0b-0b4d2ca94616 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:48.161626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-de28b444-91c6-4b4b-9a0b-0b4d2ca94616 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 14:18:48.162981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 455/911] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:48 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:48.169379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb5bf2-089e-4a70-b2fa-c1bc4b86f1e0 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:48.174385 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c6215-73a4-400f-a560-b1a66d8cef5f None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:48.174674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c6215-73a4-400f-a560-b1a66d8cef5f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:48.174954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c6215-73a4-400f-a560-b1a66d8cef5f None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:48.176791 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 456/912] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:48.179371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb5bf2-089e-4a70-b2fa-c1bc4b86f1e0 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:48.182490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3884f3-05c3-4e53-8c6c-10747df8ff8f None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:48.182786 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3884f3-05c3-4e53-8c6c-10747df8ff8f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:48.183065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3884f3-05c3-4e53-8c6c-10747df8ff8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:48.184160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612076e4-ff30-47c2-b081-2ab0308589f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:48.184815 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612076e4-ff30-47c2-b081-2ab0308589f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:48.185103 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612076e4-ff30-47c2-b081-2ab0308589f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:48.185434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612076e4-ff30-47c2-b081-2ab0308589f2 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:48.186178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612076e4-ff30-47c2-b081-2ab0308589f2 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:48.186492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612076e4-ff30-47c2-b081-2ab0308589f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:48.188090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612076e4-ff30-47c2-b081-2ab0308589f2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:48.194660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 457/913] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:48 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:48.200906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612076e4-ff30-47c2-b081-2ab0308589f2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:48.201140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-9c3884f3-05c3-4e53-8c6c-10747df8ff8f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:48.202332 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-9c3884f3-05c3-4e53-8c6c-10747df8ff8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:48.210910 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612076e4-ff30-47c2-b081-2ab0308589f2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:48.215224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421d4e6-95cf-43c1-8cf7-ea85d151b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:48.215862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421d4e6-95cf-43c1-8cf7-ea85d151b170 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:48.216142 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421d4e6-95cf-43c1-8cf7-ea85d151b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:48.216412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421d4e6-95cf-43c1-8cf7-ea85d151b170 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:48.217097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421d4e6-95cf-43c1-8cf7-ea85d151b170 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:48.217396 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421d4e6-95cf-43c1-8cf7-ea85d151b170 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:48.218162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 457/914] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:48 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:48.218989 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421d4e6-95cf-43c1-8cf7-ea85d151b170 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:48.229148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 458/915] 10.222.0.16 () {56 vars in 1134 bytes} [Sun Aug 29 14:18:48 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:48.230560 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3884f3-05c3-4e53-8c6c-10747df8ff8f None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:48.235237 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421d4e6-95cf-43c1-8cf7-ea85d151b170 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:48.240156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3884f3-05c3-4e53-8c6c-10747df8ff8f None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:48.245053 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63643cc8-7f77-4bcd-a9cb-85b5ffc890f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:48.245176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421d4e6-95cf-43c1-8cf7-ea85d151b170 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:48.246016 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63643cc8-7f77-4bcd-a9cb-85b5ffc890f3 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:48.246437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63643cc8-7f77-4bcd-a9cb-85b5ffc890f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:48.246872 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63643cc8-7f77-4bcd-a9cb-85b5ffc890f3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:48.247597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63643cc8-7f77-4bcd-a9cb-85b5ffc890f3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:48.249152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63643cc8-7f77-4bcd-a9cb-85b5ffc890f3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:48.249943 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17532e6d-46f8-4e11-963c-f458904b2635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:48.250720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17532e6d-46f8-4e11-963c-f458904b2635 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:48.251005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17532e6d-46f8-4e11-963c-f458904b2635 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:48.251281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17532e6d-46f8-4e11-963c-f458904b2635 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:48.252976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17532e6d-46f8-4e11-963c-f458904b2635 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:48.254578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17532e6d-46f8-4e11-963c-f458904b2635 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:48.266180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-17532e6d-46f8-4e11-963c-f458904b2635 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 14:18:48.275985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 459/916] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Aug 29 14:18:48 2021] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:48.275985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17532e6d-46f8-4e11-963c-f458904b2635 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:48.283950 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17532e6d-46f8-4e11-963c-f458904b2635 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:48.288618 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ae480-ef35-42d8-814a-cf50a6d4273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:48.289221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ae480-ef35-42d8-814a-cf50a6d4273d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:48.289507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ae480-ef35-42d8-814a-cf50a6d4273d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:48.289807 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ae480-ef35-42d8-814a-cf50a6d4273d admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:48.290518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ae480-ef35-42d8-814a-cf50a6d4273d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:48.290825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ae480-ef35-42d8-814a-cf50a6d4273d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:48.292367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ae480-ef35-42d8-814a-cf50a6d4273d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:48.297032 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 460/917] 10.222.0.16 () {56 vars in 1144 bytes} [Sun Aug 29 14:18:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:48.303283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ae480-ef35-42d8-814a-cf50a6d4273d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:48.312202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ae480-ef35-42d8-814a-cf50a6d4273d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:48.317248 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15426e2-e680-422c-b66a-59e6ed0c4be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:48.321021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15426e2-e680-422c-b66a-59e6ed0c4be8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:48.321021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15426e2-e680-422c-b66a-59e6ed0c4be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:48.321021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15426e2-e680-422c-b66a-59e6ed0c4be8 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:48.321021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15426e2-e680-422c-b66a-59e6ed0c4be8 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:48.321021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15426e2-e680-422c-b66a-59e6ed0c4be8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:48.321021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15426e2-e680-422c-b66a-59e6ed0c4be8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:48.325771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 461/918] 10.222.0.16 () {56 vars in 1144 bytes} [Sun Aug 29 14:18:48 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:48.332489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15426e2-e680-422c-b66a-59e6ed0c4be8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:48.341552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15426e2-e680-422c-b66a-59e6ed0c4be8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:48.346115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e602c-004e-4364-8677-0f198a8d606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:48.347214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 458/919] 10.222.0.16 () {60 vars in 1166 bytes} [Sun Aug 29 14:18:48 2021] POST /identity/v3/endpoints => generated 334 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:18:48.347329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e602c-004e-4364-8677-0f198a8d606c admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:48.347329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e602c-004e-4364-8677-0f198a8d606c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:48.347329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e602c-004e-4364-8677-0f198a8d606c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:48.348018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e602c-004e-4364-8677-0f198a8d606c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:48.349583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e602c-004e-4364-8677-0f198a8d606c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:48.427445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 462/920] 10.222.0.16 () {60 vars in 1166 bytes} [Sun Aug 29 14:18:48 2021] POST /identity/v3/endpoints => generated 325 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:18:49.923294 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892af3c-597d-4499-95d9-a77734ca869c None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:49.924824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892af3c-597d-4499-95d9-a77734ca869c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:49.924824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892af3c-597d-4499-95d9-a77734ca869c None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:49.926365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 459/921] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:49.933893 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245f7ad-0789-4fc7-a175-70c572e6131b None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:49.934320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245f7ad-0789-4fc7-a175-70c572e6131b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:49.934521 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245f7ad-0789-4fc7-a175-70c572e6131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:49.954648 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-e245f7ad-0789-4fc7-a175-70c572e6131b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:49.955874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e245f7ad-0789-4fc7-a175-70c572e6131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:49.976019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 463/922] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:49 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:50.000454 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892af3c-597d-4499-95d9-a77734ca869c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:50.013687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892af3c-597d-4499-95d9-a77734ca869c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:50.019318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410cbc1-6326-45a9-aae0-9445860737db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:50.020293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410cbc1-6326-45a9-aae0-9445860737db admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.020583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410cbc1-6326-45a9-aae0-9445860737db admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.020860 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410cbc1-6326-45a9-aae0-9445860737db admin admin] PATH_INFO: `/v3/services/image` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.021513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410cbc1-6326-45a9-aae0-9445860737db admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:50.023151 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410cbc1-6326-45a9-aae0-9445860737db admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:50.035389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-e410cbc1-6326-45a9-aae0-9445860737db admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 14:18:50.036737 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 460/923] 10.222.0.16 () {56 vars in 1127 bytes} [Sun Aug 29 14:18:49 2021] GET /identity/v3/services/image => generated 86 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:50.043412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245f7ad-0789-4fc7-a175-70c572e6131b None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:50.053376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245f7ad-0789-4fc7-a175-70c572e6131b None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:50.058036 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417404bc-83c3-4383-9505-00a38555c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:50.058701 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417404bc-83c3-4383-9505-00a38555c3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.058984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417404bc-83c3-4383-9505-00a38555c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.059259 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417404bc-83c3-4383-9505-00a38555c3f7 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.059965 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417404bc-83c3-4383-9505-00a38555c3f7 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:50.060274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417404bc-83c3-4383-9505-00a38555c3f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:50.061905 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417404bc-83c3-4383-9505-00a38555c3f7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:50.067807 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 464/924] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:50 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:50.074113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410cbc1-6326-45a9-aae0-9445860737db admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:50.084686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410cbc1-6326-45a9-aae0-9445860737db admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:50.089212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13dad7-0ae5-4b96-ab07-1969679afefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:50.089856 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13dad7-0ae5-4b96-ab07-1969679afefe admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.090158 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13dad7-0ae5-4b96-ab07-1969679afefe admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.090434 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13dad7-0ae5-4b96-ab07-1969679afefe admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.091122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13dad7-0ae5-4b96-ab07-1969679afefe admin admin] RBAC: Adding query filter params (type=image) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:50.091421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13dad7-0ae5-4b96-ab07-1969679afefe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:50.092984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13dad7-0ae5-4b96-ab07-1969679afefe admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:50.099414 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 461/925] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:50 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:50.104937 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417404bc-83c3-4383-9505-00a38555c3f7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:50.114614 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417404bc-83c3-4383-9505-00a38555c3f7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:50.119201 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eaf49-8dc8-4ed1-ab3b-a60c719f2418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:50.119918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eaf49-8dc8-4ed1-ab3b-a60c719f2418 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.120269 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eaf49-8dc8-4ed1-ab3b-a60c719f2418 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.120614 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eaf49-8dc8-4ed1-ab3b-a60c719f2418 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.121412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825eaf49-8dc8-4ed1-ab3b-a60c719f2418 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:50.123029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825eaf49-8dc8-4ed1-ab3b-a60c719f2418 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:50.222063 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 465/926] 10.222.0.16 () {60 vars in 1166 bytes} [Sun Aug 29 14:18:50 2021] POST /identity/v3/endpoints => generated 327 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:50.610529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed277af0-9732-48be-8a45-7da3a5339612 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.610911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed277af0-9732-48be-8a45-7da3a5339612 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.611626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed277af0-9732-48be-8a45-7da3a5339612 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.613562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 462/927] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:50.619271 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d57377-39d6-4d87-a618-31b2eb3aabad None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.619563 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d57377-39d6-4d87-a618-31b2eb3aabad None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.619839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d57377-39d6-4d87-a618-31b2eb3aabad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.639151 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-77d57377-39d6-4d87-a618-31b2eb3aabad None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:50.640324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-77d57377-39d6-4d87-a618-31b2eb3aabad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:50.644790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f716-4396-43b4-898b-48218c864933 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.645038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f716-4396-43b4-898b-48218c864933 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.645310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f716-4396-43b4-898b-48218c864933 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.647242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 463/928] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:50.652529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837431df-63c6-404f-ac65-7c2a026a462d None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.652815 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837431df-63c6-404f-ac65-7c2a026a462d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.653092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837431df-63c6-404f-ac65-7c2a026a462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.657244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 466/929] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:50.670633 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-837431df-63c6-404f-ac65-7c2a026a462d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:50.671810 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-837431df-63c6-404f-ac65-7c2a026a462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:50.680045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 464/930] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:50.682656 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d57377-39d6-4d87-a618-31b2eb3aabad None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:50.691498 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d57377-39d6-4d87-a618-31b2eb3aabad None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:50.695901 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ca8be-f8d7-4d09-98e3-3fd3991ef5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:50.696694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ca8be-f8d7-4d09-98e3-3fd3991ef5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.696970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ca8be-f8d7-4d09-98e3-3fd3991ef5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.697238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ca8be-f8d7-4d09-98e3-3fd3991ef5b3 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.704130 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837431df-63c6-404f-ac65-7c2a026a462d None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:50.707331 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ca8be-f8d7-4d09-98e3-3fd3991ef5b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:50.712913 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837431df-63c6-404f-ac65-7c2a026a462d None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:50.714499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-5a0ca8be-f8d7-4d09-98e3-3fd3991ef5b3 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 14:18:50.715892 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 467/931] 10.222.0.16 () {56 vars in 1142 bytes} [Sun Aug 29 14:18:50 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:50.717950 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdf8ba-a185-4b51-ab85-0a0260a2a4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:50.718739 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf8ba-a185-4b51-ab85-0a0260a2a4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.719034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf8ba-a185-4b51-ab85-0a0260a2a4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.719282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf8ba-a185-4b51-ab85-0a0260a2a4d2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.720982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdf8ba-a185-4b51-ab85-0a0260a2a4d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:50.722664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ca8be-f8d7-4d09-98e3-3fd3991ef5b3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:50.722783 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdf8ba-a185-4b51-ab85-0a0260a2a4d2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:50.725903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 465/932] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:50.730272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdf8ba-a185-4b51-ab85-0a0260a2a4d2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:50.733225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ca8be-f8d7-4d09-98e3-3fd3991ef5b3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:50.739039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9e78f-7532-49c4-a16e-0c8cb59437e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:50.739685 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9e78f-7532-49c4-a16e-0c8cb59437e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.739967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9e78f-7532-49c4-a16e-0c8cb59437e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.740241 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9e78f-7532-49c4-a16e-0c8cb59437e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.740980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9e78f-7532-49c4-a16e-0c8cb59437e3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:50.741284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9e78f-7532-49c4-a16e-0c8cb59437e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:50.742282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdf8ba-a185-4b51-ab85-0a0260a2a4d2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:50.742921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9e78f-7532-49c4-a16e-0c8cb59437e3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:50.747631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddfc4c-a81a-4fb0-8e64-064e97c7c123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:50.748894 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddfc4c-a81a-4fb0-8e64-064e97c7c123 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.749546 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddfc4c-a81a-4fb0-8e64-064e97c7c123 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.749992 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddfc4c-a81a-4fb0-8e64-064e97c7c123 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.750823 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddfc4c-a81a-4fb0-8e64-064e97c7c123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:50.751118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 468/933] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Aug 29 14:18:50 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:50.753073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddfc4c-a81a-4fb0-8e64-064e97c7c123 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:50.757785 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9e78f-7532-49c4-a16e-0c8cb59437e3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:50.766946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9e78f-7532-49c4-a16e-0c8cb59437e3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:50.772697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e317935-8cd4-42f0-a653-a67a5bce6ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:50.773597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e317935-8cd4-42f0-a653-a67a5bce6ade admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.773989 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e317935-8cd4-42f0-a653-a67a5bce6ade admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.774265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e317935-8cd4-42f0-a653-a67a5bce6ade admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.784938 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e317935-8cd4-42f0-a653-a67a5bce6ade admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:50.786788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e317935-8cd4-42f0-a653-a67a5bce6ade admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:50.803066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-6e317935-8cd4-42f0-a653-a67a5bce6ade admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:50.804244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 469/934] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:50.810304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e317935-8cd4-42f0-a653-a67a5bce6ade admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:50.819372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e317935-8cd4-42f0-a653-a67a5bce6ade admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:50.823979 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982326-9d1d-49f1-9af7-98ace93b42f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:50.824577 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982326-9d1d-49f1-9af7-98ace93b42f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.824857 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982326-9d1d-49f1-9af7-98ace93b42f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.825128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982326-9d1d-49f1-9af7-98ace93b42f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.825817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de982326-9d1d-49f1-9af7-98ace93b42f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:50.826151 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de982326-9d1d-49f1-9af7-98ace93b42f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:50.827679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de982326-9d1d-49f1-9af7-98ace93b42f8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:50.839342 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 470/935] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:50.845134 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982326-9d1d-49f1-9af7-98ace93b42f8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:50.854669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982326-9d1d-49f1-9af7-98ace93b42f8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:50.859180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d528e-dfea-4283-a08f-5db4a51e4cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:50.859912 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d528e-dfea-4283-a08f-5db4a51e4cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.860197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d528e-dfea-4283-a08f-5db4a51e4cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.860472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d528e-dfea-4283-a08f-5db4a51e4cf5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.868068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d528e-dfea-4283-a08f-5db4a51e4cf5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:50.869996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d528e-dfea-4283-a08f-5db4a51e4cf5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:50.882980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-0c8d528e-dfea-4283-a08f-5db4a51e4cf5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 14:18:50.884932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 466/936] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:18:50 2021] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:18:50.893587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 471/937] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Aug 29 14:18:50 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:50.894887 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddfc4c-a81a-4fb0-8e64-064e97c7c123 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:50.965747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddfc4c-a81a-4fb0-8e64-064e97c7c123 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:50.971321 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6606cbc-5ef4-41e3-914c-3110f0324698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:50.972172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6606cbc-5ef4-41e3-914c-3110f0324698 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:50.972451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6606cbc-5ef4-41e3-914c-3110f0324698 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:50.972738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6606cbc-5ef4-41e3-914c-3110f0324698 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:50.973595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6606cbc-5ef4-41e3-914c-3110f0324698 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:50.973931 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6606cbc-5ef4-41e3-914c-3110f0324698 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:50.975815 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6606cbc-5ef4-41e3-914c-3110f0324698 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:50.995415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 467/938] 10.222.0.16 () {56 vars in 1155 bytes} [Sun Aug 29 14:18:50 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:51.001945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d528e-dfea-4283-a08f-5db4a51e4cf5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:51.015876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d528e-dfea-4283-a08f-5db4a51e4cf5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:51.023051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc12f79-09fd-4652-87d6-02d77c9a9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:51.024168 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc12f79-09fd-4652-87d6-02d77c9a9011 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:51.024671 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc12f79-09fd-4652-87d6-02d77c9a9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:51.025171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc12f79-09fd-4652-87d6-02d77c9a9011 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:51.039680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc12f79-09fd-4652-87d6-02d77c9a9011 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:51.042937 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc12f79-09fd-4652-87d6-02d77c9a9011 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:51.059106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 472/939] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:51 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:51.070048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6606cbc-5ef4-41e3-914c-3110f0324698 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:51.084440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6606cbc-5ef4-41e3-914c-3110f0324698 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:51.089271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866906b5-82a4-4e7e-8cea-abadf45263c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:51.090092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866906b5-82a4-4e7e-8cea-abadf45263c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:51.090381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866906b5-82a4-4e7e-8cea-abadf45263c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:51.090660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866906b5-82a4-4e7e-8cea-abadf45263c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:51.103122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866906b5-82a4-4e7e-8cea-abadf45263c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:51.104962 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866906b5-82a4-4e7e-8cea-abadf45263c2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:51.122607 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-866906b5-82a4-4e7e-8cea-abadf45263c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:51.123758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 468/940] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:51.130480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc12f79-09fd-4652-87d6-02d77c9a9011 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:51.139797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc12f79-09fd-4652-87d6-02d77c9a9011 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:51.145314 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe51d9c-d286-405b-8087-91a0b7b20dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:51.146004 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe51d9c-d286-405b-8087-91a0b7b20dfd admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:51.146288 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe51d9c-d286-405b-8087-91a0b7b20dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:51.146560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe51d9c-d286-405b-8087-91a0b7b20dfd admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:51.147274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe51d9c-d286-405b-8087-91a0b7b20dfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:51.147604 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe51d9c-d286-405b-8087-91a0b7b20dfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:51.149173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe51d9c-d286-405b-8087-91a0b7b20dfd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:51.162180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 473/941] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:51.168198 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866906b5-82a4-4e7e-8cea-abadf45263c2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:51.177971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866906b5-82a4-4e7e-8cea-abadf45263c2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:51.182416 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9de88-daff-4836-aa00-2a7dad72341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:51.183193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9de88-daff-4836-aa00-2a7dad72341a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:51.183468 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9de88-daff-4836-aa00-2a7dad72341a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:51.183735 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9de88-daff-4836-aa00-2a7dad72341a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:51.191081 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9de88-daff-4836-aa00-2a7dad72341a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:51.193010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9de88-daff-4836-aa00-2a7dad72341a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:51.206406 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-d0f9de88-daff-4836-aa00-2a7dad72341a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:51.207726 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 469/942] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:51.214174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe51d9c-d286-405b-8087-91a0b7b20dfd admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:51.224135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe51d9c-d286-405b-8087-91a0b7b20dfd admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:51.228597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e86694-a5be-41ef-8273-7f261bf58555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:51.229245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e86694-a5be-41ef-8273-7f261bf58555 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:51.229522 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e86694-a5be-41ef-8273-7f261bf58555 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:51.229792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e86694-a5be-41ef-8273-7f261bf58555 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:51.230614 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e86694-a5be-41ef-8273-7f261bf58555 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:51.230920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e86694-a5be-41ef-8273-7f261bf58555 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:51.232747 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e86694-a5be-41ef-8273-7f261bf58555 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:51.244639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 474/943] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:51.251053 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9de88-daff-4836-aa00-2a7dad72341a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:51.262300 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9de88-daff-4836-aa00-2a7dad72341a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:51.266809 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dad16c-520a-41d7-a6c1-be7bd4b265d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:51.268085 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad16c-520a-41d7-a6c1-be7bd4b265d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:51.268428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad16c-520a-41d7-a6c1-be7bd4b265d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:51.268700 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad16c-520a-41d7-a6c1-be7bd4b265d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:51.269513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dad16c-520a-41d7-a6c1-be7bd4b265d8 admin admin] RBAC: Adding query filter params (role.id=e1eed6eb3c344f43bd3ea8c3751a272f, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=d8c0afa8f09f4923b9c8ab2696156129) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:51.269836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dad16c-520a-41d7-a6c1-be7bd4b265d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:51.271682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dad16c-520a-41d7-a6c1-be7bd4b265d8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:51.277305 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 470/944] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:51 2021] GET /identity/v3/role_assignments?user.id=d8c0afa8f09f4923b9c8ab2696156129&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=e1eed6eb3c344f43bd3ea8c3751a272f => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:52.435414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fda84-2e62-46f5-a85e-593151f6eeef None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:52.435947 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fda84-2e62-46f5-a85e-593151f6eeef None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:52.435947 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fda84-2e62-46f5-a85e-593151f6eeef None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:52.437802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 475/945] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:52.444791 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0e30d-9e12-4bf1-9ed5-6a9049e49710 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:52.445301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0e30d-9e12-4bf1-9ed5-6a9049e49710 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:52.445407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0e30d-9e12-4bf1-9ed5-6a9049e49710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:52.463345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-dba0e30d-9e12-4bf1-9ed5-6a9049e49710 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:52.464531 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-dba0e30d-9e12-4bf1-9ed5-6a9049e49710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:52.472644 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 471/946] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:52 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:52.495980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fda84-2e62-46f5-a85e-593151f6eeef None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:52.508536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fda84-2e62-46f5-a85e-593151f6eeef None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:52.512822 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0798650-5c10-4410-bdc4-6ef1aff5848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:52.513492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0798650-5c10-4410-bdc4-6ef1aff5848c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:52.513779 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0798650-5c10-4410-bdc4-6ef1aff5848c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:52.514080 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0798650-5c10-4410-bdc4-6ef1aff5848c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:52.522338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0798650-5c10-4410-bdc4-6ef1aff5848c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:52.524068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0798650-5c10-4410-bdc4-6ef1aff5848c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:52.533351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 476/947] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:52 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:18:52.539729 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0e30d-9e12-4bf1-9ed5-6a9049e49710 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:52.548734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0e30d-9e12-4bf1-9ed5-6a9049e49710 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:52.553313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ac28e-bb54-425d-9ad5-7f1e492fdaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:52.554206 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ac28e-bb54-425d-9ad5-7f1e492fdaea admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:52.554557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ac28e-bb54-425d-9ad5-7f1e492fdaea admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:52.554898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ac28e-bb54-425d-9ad5-7f1e492fdaea admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:52.556139 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ac28e-bb54-425d-9ad5-7f1e492fdaea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:52.557857 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ac28e-bb54-425d-9ad5-7f1e492fdaea admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:52.559577 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 472/948] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:53.221670 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed3eef-ba60-4f0e-a7b4-e2a78ab941ed None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.221853 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed3eef-ba60-4f0e-a7b4-e2a78ab941ed None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.222239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed3eef-ba60-4f0e-a7b4-e2a78ab941ed None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.224035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 477/949] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:53.230025 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c230e-1368-4924-bf3b-6a6ba52cab55 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.230375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c230e-1368-4924-bf3b-6a6ba52cab55 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.230714 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c230e-1368-4924-bf3b-6a6ba52cab55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.247858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-8f1c230e-1368-4924-bf3b-6a6ba52cab55 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:53.249058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8f1c230e-1368-4924-bf3b-6a6ba52cab55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:53.256634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 473/950] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:53.282495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed3eef-ba60-4f0e-a7b4-e2a78ab941ed None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.294998 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed3eef-ba60-4f0e-a7b4-e2a78ab941ed None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.299346 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797dcde-8441-4e0d-9b1c-dd7abb51542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.300171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797dcde-8441-4e0d-9b1c-dd7abb51542f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.300450 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797dcde-8441-4e0d-9b1c-dd7abb51542f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.300718 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797dcde-8441-4e0d-9b1c-dd7abb51542f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.301885 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797dcde-8441-4e0d-9b1c-dd7abb51542f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:53.303559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797dcde-8441-4e0d-9b1c-dd7abb51542f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:53.305120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 478/951] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:53.311468 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c230e-1368-4924-bf3b-6a6ba52cab55 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.320856 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c230e-1368-4924-bf3b-6a6ba52cab55 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.325366 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db798fd1-1777-495a-8b78-160b3dab8b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.326060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db798fd1-1777-495a-8b78-160b3dab8b8c admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.326343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db798fd1-1777-495a-8b78-160b3dab8b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.326617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db798fd1-1777-495a-8b78-160b3dab8b8c admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.327320 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db798fd1-1777-495a-8b78-160b3dab8b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:53.329220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db798fd1-1777-495a-8b78-160b3dab8b8c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:53.403472 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 474/952] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:18:53 2021] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:18:53.428928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84792d5a-d47e-4306-a4cf-31c8cd09473d None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.429242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84792d5a-d47e-4306-a4cf-31c8cd09473d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.429519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84792d5a-d47e-4306-a4cf-31c8cd09473d None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.431394 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 479/953] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:53.438227 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e47b45-d522-42cb-8e58-45cc8c6633ef None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.438516 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e47b45-d522-42cb-8e58-45cc8c6633ef None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.438795 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e47b45-d522-42cb-8e58-45cc8c6633ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.458339 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-a2e47b45-d522-42cb-8e58-45cc8c6633ef None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:53.459587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a2e47b45-d522-42cb-8e58-45cc8c6633ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:53.467708 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 475/954] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:53.492537 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84792d5a-d47e-4306-a4cf-31c8cd09473d None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.506170 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84792d5a-d47e-4306-a4cf-31c8cd09473d None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.510952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3622017-ecbf-4859-9b37-df6860ad6b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.511769 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3622017-ecbf-4859-9b37-df6860ad6b9c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.512047 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3622017-ecbf-4859-9b37-df6860ad6b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.512322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3622017-ecbf-4859-9b37-df6860ad6b9c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.524696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3622017-ecbf-4859-9b37-df6860ad6b9c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:53.532110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-e3622017-ecbf-4859-9b37-df6860ad6b9c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 14:18:53.534139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 480/955] 10.222.0.16 () {56 vars in 1142 bytes} [Sun Aug 29 14:18:53 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:53.541172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e47b45-d522-42cb-8e58-45cc8c6633ef None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.551222 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e47b45-d522-42cb-8e58-45cc8c6633ef None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.555801 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a90858-b2b2-4077-8ea9-78fe77f0803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.556471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a90858-b2b2-4077-8ea9-78fe77f0803a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.556746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a90858-b2b2-4077-8ea9-78fe77f0803a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.557017 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a90858-b2b2-4077-8ea9-78fe77f0803a admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.557763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a90858-b2b2-4077-8ea9-78fe77f0803a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:53.558096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a90858-b2b2-4077-8ea9-78fe77f0803a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:53.559693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a90858-b2b2-4077-8ea9-78fe77f0803a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:53.568381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 476/956] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Aug 29 14:18:53 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:53.575126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3622017-ecbf-4859-9b37-df6860ad6b9c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.585525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3622017-ecbf-4859-9b37-df6860ad6b9c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.590146 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d3713-caef-4f94-9d11-c6e22a229fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.590928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d3713-caef-4f94-9d11-c6e22a229fbd admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.591209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d3713-caef-4f94-9d11-c6e22a229fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.591480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d3713-caef-4f94-9d11-c6e22a229fbd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.602199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d3713-caef-4f94-9d11-c6e22a229fbd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:53.604020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d3713-caef-4f94-9d11-c6e22a229fbd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:53.621015 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-930d3713-caef-4f94-9d11-c6e22a229fbd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:53.622510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 481/957] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:53.632032 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a90858-b2b2-4077-8ea9-78fe77f0803a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.642821 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a90858-b2b2-4077-8ea9-78fe77f0803a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.647334 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee1f39-0239-4769-a179-be2f1e315475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.647983 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee1f39-0239-4769-a179-be2f1e315475 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.648260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee1f39-0239-4769-a179-be2f1e315475 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.648529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee1f39-0239-4769-a179-be2f1e315475 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.649239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee1f39-0239-4769-a179-be2f1e315475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:53.649566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee1f39-0239-4769-a179-be2f1e315475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:53.651344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee1f39-0239-4769-a179-be2f1e315475 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:53.663705 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 477/958] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:53.670324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d3713-caef-4f94-9d11-c6e22a229fbd admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.679941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d3713-caef-4f94-9d11-c6e22a229fbd admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.685521 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f345d97-0e3e-4e0a-8c95-3c6369961f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.686327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f345d97-0e3e-4e0a-8c95-3c6369961f54 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.686610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f345d97-0e3e-4e0a-8c95-3c6369961f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.686886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f345d97-0e3e-4e0a-8c95-3c6369961f54 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.694538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f345d97-0e3e-4e0a-8c95-3c6369961f54 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:53.696550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f345d97-0e3e-4e0a-8c95-3c6369961f54 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:53.710633 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-7f345d97-0e3e-4e0a-8c95-3c6369961f54 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 14:18:53.711784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 482/959] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Aug 29 14:18:53 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:53.718370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee1f39-0239-4769-a179-be2f1e315475 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.728418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee1f39-0239-4769-a179-be2f1e315475 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.732998 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e335-05db-4882-8349-9ddfd624eee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.733648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e335-05db-4882-8349-9ddfd624eee2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.733953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e335-05db-4882-8349-9ddfd624eee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.734224 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e335-05db-4882-8349-9ddfd624eee2 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.735048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e335-05db-4882-8349-9ddfd624eee2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:53.735348 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e335-05db-4882-8349-9ddfd624eee2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:53.737761 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e335-05db-4882-8349-9ddfd624eee2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:53.754993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 478/960] 10.222.0.16 () {56 vars in 1155 bytes} [Sun Aug 29 14:18:53 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:53.762921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f345d97-0e3e-4e0a-8c95-3c6369961f54 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.773438 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f345d97-0e3e-4e0a-8c95-3c6369961f54 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.777843 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133df20-a291-40f3-9b5f-a49c6c98606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.778645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133df20-a291-40f3-9b5f-a49c6c98606f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.778923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133df20-a291-40f3-9b5f-a49c6c98606f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.779192 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133df20-a291-40f3-9b5f-a49c6c98606f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.789616 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133df20-a291-40f3-9b5f-a49c6c98606f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:53.791457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133df20-a291-40f3-9b5f-a49c6c98606f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:53.807710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-2133df20-a291-40f3-9b5f-a49c6c98606f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:53.808870 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 483/961] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:53.815307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e335-05db-4882-8349-9ddfd624eee2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.824922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e335-05db-4882-8349-9ddfd624eee2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.829377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff511-61e1-442b-8ab1-2c8bd3211d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.830559 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff511-61e1-442b-8ab1-2c8bd3211d2e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.830837 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff511-61e1-442b-8ab1-2c8bd3211d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.831110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff511-61e1-442b-8ab1-2c8bd3211d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.831820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ff511-61e1-442b-8ab1-2c8bd3211d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:53.832122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ff511-61e1-442b-8ab1-2c8bd3211d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:53.833680 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ff511-61e1-442b-8ab1-2c8bd3211d2e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:53.844489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 479/962] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:53.851217 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133df20-a291-40f3-9b5f-a49c6c98606f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.860797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133df20-a291-40f3-9b5f-a49c6c98606f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.865276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58a507-baa9-49d3-986e-e8df3028d917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.866081 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a507-baa9-49d3-986e-e8df3028d917 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.866449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a507-baa9-49d3-986e-e8df3028d917 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.866717 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a507-baa9-49d3-986e-e8df3028d917 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.873258 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58a507-baa9-49d3-986e-e8df3028d917 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:53.875221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58a507-baa9-49d3-986e-e8df3028d917 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:53.888036 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-2e58a507-baa9-49d3-986e-e8df3028d917 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:53.889146 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 484/963] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:53.895893 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff511-61e1-442b-8ab1-2c8bd3211d2e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.905572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff511-61e1-442b-8ab1-2c8bd3211d2e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.910707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308df9e6-59f6-4f9f-9da9-67891d4c4642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.911414 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308df9e6-59f6-4f9f-9da9-67891d4c4642 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.911760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308df9e6-59f6-4f9f-9da9-67891d4c4642 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.912115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308df9e6-59f6-4f9f-9da9-67891d4c4642 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.912958 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308df9e6-59f6-4f9f-9da9-67891d4c4642 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:53.913332 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308df9e6-59f6-4f9f-9da9-67891d4c4642 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:53.915179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308df9e6-59f6-4f9f-9da9-67891d4c4642 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:53.931925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 480/964] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:53.933078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58a507-baa9-49d3-986e-e8df3028d917 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:53.943497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58a507-baa9-49d3-986e-e8df3028d917 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:53.950497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38643192-1b8d-4ff5-92a3-f6151975162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:53.950497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38643192-1b8d-4ff5-92a3-f6151975162f admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:53.950497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38643192-1b8d-4ff5-92a3-f6151975162f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:53.950497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38643192-1b8d-4ff5-92a3-f6151975162f admin admin] PATH_INFO: `/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/d8c0afa8f09f4923b9c8ab2696156129/roles/e1eed6eb3c344f43bd3ea8c3751a272f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:53.951690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38643192-1b8d-4ff5-92a3-f6151975162f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c728e9160de45afbd4902c27eef45b3, user_id=d8c0afa8f09f4923b9c8ab2696156129, role_id=e1eed6eb3c344f43bd3ea8c3751a272f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:53.955029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38643192-1b8d-4ff5-92a3-f6151975162f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:54.059296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 485/965] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:18:53 2021] PUT /identity/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/d8c0afa8f09f4923b9c8ab2696156129/roles/e1eed6eb3c344f43bd3ea8c3751a272f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:18:55.594802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c698e-8da1-44ee-a5b8-26d519a7440d None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:55.595446 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c698e-8da1-44ee-a5b8-26d519a7440d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:55.595630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c698e-8da1-44ee-a5b8-26d519a7440d None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:55.597323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 481/966] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:55.603387 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109189a-939e-4e2c-af8e-fe3220520195 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:55.603773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109189a-939e-4e2c-af8e-fe3220520195 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:55.604078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109189a-939e-4e2c-af8e-fe3220520195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:55.621978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-2109189a-939e-4e2c-af8e-fe3220520195 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:55.623154 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2109189a-939e-4e2c-af8e-fe3220520195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:55.680092 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 486/967] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:55.705552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c698e-8da1-44ee-a5b8-26d519a7440d None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:55.717354 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c698e-8da1-44ee-a5b8-26d519a7440d None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:55.722339 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ded2fd-5d7f-4689-a197-d0394e81544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:55.723103 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded2fd-5d7f-4689-a197-d0394e81544e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:55.723379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded2fd-5d7f-4689-a197-d0394e81544e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:55.723648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded2fd-5d7f-4689-a197-d0394e81544e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:55.733566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ded2fd-5d7f-4689-a197-d0394e81544e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:55.740889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-a6ded2fd-5d7f-4689-a197-d0394e81544e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:18:55.742076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 482/968] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:55.748811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109189a-939e-4e2c-af8e-fe3220520195 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:55.758039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109189a-939e-4e2c-af8e-fe3220520195 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:55.762561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0620d28-0267-449c-8602-bd6c40e7f99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:55.763218 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0620d28-0267-449c-8602-bd6c40e7f99a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:55.763530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0620d28-0267-449c-8602-bd6c40e7f99a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:55.763807 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0620d28-0267-449c-8602-bd6c40e7f99a admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:55.764550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0620d28-0267-449c-8602-bd6c40e7f99a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:55.764855 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0620d28-0267-449c-8602-bd6c40e7f99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:55.766500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0620d28-0267-449c-8602-bd6c40e7f99a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:55.774837 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 487/969] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:55.781010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ded2fd-5d7f-4689-a197-d0394e81544e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:55.791591 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ded2fd-5d7f-4689-a197-d0394e81544e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:55.795985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ce955-f7a3-487b-8491-6ecb97f3cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:55.796819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ce955-f7a3-487b-8491-6ecb97f3cce3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:55.797092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ce955-f7a3-487b-8491-6ecb97f3cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:55.797356 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ce955-f7a3-487b-8491-6ecb97f3cce3 admin admin] PATH_INFO: `/v3/users/072d7266e7384af58901ab6b4ac20dbf` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:55.810490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ce955-f7a3-487b-8491-6ecb97f3cce3 admin admin] RBAC: Authorizing `identity:get_user(user_id=072d7266e7384af58901ab6b4ac20dbf)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:55.812590 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ce955-f7a3-487b-8491-6ecb97f3cce3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:55.819597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 483/970] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:18:55 2021] GET /identity/v3/users/072d7266e7384af58901ab6b4ac20dbf => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:55.820784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0620d28-0267-449c-8602-bd6c40e7f99a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:55.830601 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0620d28-0267-449c-8602-bd6c40e7f99a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:55.835127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207ce31-01b9-4691-a3ea-21990a17706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:55.835765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207ce31-01b9-4691-a3ea-21990a17706e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:55.836047 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207ce31-01b9-4691-a3ea-21990a17706e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:55.836322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207ce31-01b9-4691-a3ea-21990a17706e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:55.843982 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207ce31-01b9-4691-a3ea-21990a17706e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:55.846519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207ce31-01b9-4691-a3ea-21990a17706e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:55.855312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 488/971] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:55 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:55.862456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ce955-f7a3-487b-8491-6ecb97f3cce3 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:55.872079 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ce955-f7a3-487b-8491-6ecb97f3cce3 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:55.876555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a7c4b-f54f-4b03-98d6-8c41e5e40b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:55.877390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a7c4b-f54f-4b03-98d6-8c41e5e40b18 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:55.877665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a7c4b-f54f-4b03-98d6-8c41e5e40b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:55.877966 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a7c4b-f54f-4b03-98d6-8c41e5e40b18 admin admin] PATH_INFO: `/v3/projects/6c97ccf13c44446abf43db9c4897c198` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:55.879116 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a7c4b-f54f-4b03-98d6-8c41e5e40b18 admin admin] RBAC: Authorizing `identity:get_project(project_id=6c97ccf13c44446abf43db9c4897c198)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:55.881123 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a7c4b-f54f-4b03-98d6-8c41e5e40b18 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:55.883184 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 484/972] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:18:55 2021] GET /identity/v3/projects/6c97ccf13c44446abf43db9c4897c198 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:55.889581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207ce31-01b9-4691-a3ea-21990a17706e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:55.898689 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207ce31-01b9-4691-a3ea-21990a17706e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:55.903360 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6efc6-19b3-4b80-bd35-06f3452a0e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:55.903998 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6efc6-19b3-4b80-bd35-06f3452a0e9e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:55.904282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6efc6-19b3-4b80-bd35-06f3452a0e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:55.904556 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6efc6-19b3-4b80-bd35-06f3452a0e9e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:55.905367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6efc6-19b3-4b80-bd35-06f3452a0e9e admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=6c97ccf13c44446abf43db9c4897c198, user.id=072d7266e7384af58901ab6b4ac20dbf) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:55.905679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6efc6-19b3-4b80-bd35-06f3452a0e9e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:55.908098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6efc6-19b3-4b80-bd35-06f3452a0e9e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:55.913480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 489/973] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:55 2021] GET /identity/v3/role_assignments?user.id=072d7266e7384af58901ab6b4ac20dbf&scope.project.id=6c97ccf13c44446abf43db9c4897c198&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:56.211956 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d0d83-9313-4b87-b1e3-a7630f1d8f51 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.212142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d0d83-9313-4b87-b1e3-a7630f1d8f51 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.212431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d0d83-9313-4b87-b1e3-a7630f1d8f51 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.215224 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 485/974] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:18:56.220992 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73363ebb-430d-4e58-83d8-978f5d80d81d None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.221284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73363ebb-430d-4e58-83d8-978f5d80d81d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.221561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73363ebb-430d-4e58-83d8-978f5d80d81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.240669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-73363ebb-430d-4e58-83d8-978f5d80d81d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:56.241990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-73363ebb-430d-4e58-83d8-978f5d80d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:56.250575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 490/975] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:18:56.283993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d0d83-9313-4b87-b1e3-a7630f1d8f51 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:56.296016 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d0d83-9313-4b87-b1e3-a7630f1d8f51 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:56.300421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6223e-2834-4e6c-9383-673efebee8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:56.301209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6223e-2834-4e6c-9383-673efebee8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.301490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6223e-2834-4e6c-9383-673efebee8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.301762 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6223e-2834-4e6c-9383-673efebee8c9 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.311602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6223e-2834-4e6c-9383-673efebee8c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:56.318994 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-aaa6223e-2834-4e6c-9383-673efebee8c9 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 14:18:56.320067 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 486/976] 10.222.0.16 () {56 vars in 1142 bytes} [Sun Aug 29 14:18:56 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:56.326445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73363ebb-430d-4e58-83d8-978f5d80d81d None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:56.335802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73363ebb-430d-4e58-83d8-978f5d80d81d None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:56.340284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e95bc-f4ca-4176-9680-2339357f742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:56.340934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e95bc-f4ca-4176-9680-2339357f742a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.341216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e95bc-f4ca-4176-9680-2339357f742a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.341485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e95bc-f4ca-4176-9680-2339357f742a admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.342258 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e95bc-f4ca-4176-9680-2339357f742a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:56.342559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e95bc-f4ca-4176-9680-2339357f742a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:56.344141 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e95bc-f4ca-4176-9680-2339357f742a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:56.352590 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 491/977] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Aug 29 14:18:56 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:56.358653 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6223e-2834-4e6c-9383-673efebee8c9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:56.368824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6223e-2834-4e6c-9383-673efebee8c9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:56.373308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68bfb9-a507-47e8-b284-0cb0d2246704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:56.374109 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68bfb9-a507-47e8-b284-0cb0d2246704 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.374394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68bfb9-a507-47e8-b284-0cb0d2246704 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.374670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68bfb9-a507-47e8-b284-0cb0d2246704 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.384828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68bfb9-a507-47e8-b284-0cb0d2246704 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:56.386668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68bfb9-a507-47e8-b284-0cb0d2246704 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:56.403204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-6e68bfb9-a507-47e8-b284-0cb0d2246704 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:56.404327 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 487/978] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:56.411089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e95bc-f4ca-4176-9680-2339357f742a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:56.420453 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e95bc-f4ca-4176-9680-2339357f742a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:56.425089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8e8d5-90c4-4c81-9924-cfc45282d8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:56.425808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e8d5-90c4-4c81-9924-cfc45282d8de admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.426184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e8d5-90c4-4c81-9924-cfc45282d8de admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.426519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e8d5-90c4-4c81-9924-cfc45282d8de admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.427282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8e8d5-90c4-4c81-9924-cfc45282d8de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:56.427647 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8e8d5-90c4-4c81-9924-cfc45282d8de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:56.429256 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8e8d5-90c4-4c81-9924-cfc45282d8de admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:56.441162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 492/979] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:56.447155 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68bfb9-a507-47e8-b284-0cb0d2246704 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:56.457078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68bfb9-a507-47e8-b284-0cb0d2246704 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:56.461582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b933e-3887-4578-9bf9-dbe472d013cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:56.462434 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b933e-3887-4578-9bf9-dbe472d013cb admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.462666 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b933e-3887-4578-9bf9-dbe472d013cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.462960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b933e-3887-4578-9bf9-dbe472d013cb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.470028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b933e-3887-4578-9bf9-dbe472d013cb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:56.472023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b933e-3887-4578-9bf9-dbe472d013cb admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:56.485653 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-1b2b933e-3887-4578-9bf9-dbe472d013cb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 14:18:56.486835 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 488/980] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Aug 29 14:18:56 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:56.493002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8e8d5-90c4-4c81-9924-cfc45282d8de admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:56.503759 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8e8d5-90c4-4c81-9924-cfc45282d8de admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:56.508487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b1ad7-83f6-458e-ba8d-10d547333791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:56.509138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b1ad7-83f6-458e-ba8d-10d547333791 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.509419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b1ad7-83f6-458e-ba8d-10d547333791 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.509696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b1ad7-83f6-458e-ba8d-10d547333791 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.510558 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b1ad7-83f6-458e-ba8d-10d547333791 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:56.510864 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b1ad7-83f6-458e-ba8d-10d547333791 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:56.512694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b1ad7-83f6-458e-ba8d-10d547333791 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:56.530503 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 493/981] 10.222.0.16 () {56 vars in 1155 bytes} [Sun Aug 29 14:18:56 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:18:56.537080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b933e-3887-4578-9bf9-dbe472d013cb admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:56.546464 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b933e-3887-4578-9bf9-dbe472d013cb admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:56.551036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfce43-07e6-4b47-8089-d47062d04d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:56.551659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfce43-07e6-4b47-8089-d47062d04d88 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.551940 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfce43-07e6-4b47-8089-d47062d04d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.552213 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfce43-07e6-4b47-8089-d47062d04d88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.559692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfce43-07e6-4b47-8089-d47062d04d88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:56.561411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfce43-07e6-4b47-8089-d47062d04d88 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:56.570848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 489/982] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:18:56 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:18:56.577011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b1ad7-83f6-458e-ba8d-10d547333791 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:56.587829 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b1ad7-83f6-458e-ba8d-10d547333791 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:56.592425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066425e3-2985-4182-8c32-71bbd63fe33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:56.593205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066425e3-2985-4182-8c32-71bbd63fe33d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.593492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066425e3-2985-4182-8c32-71bbd63fe33d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.593765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066425e3-2985-4182-8c32-71bbd63fe33d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.604815 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066425e3-2985-4182-8c32-71bbd63fe33d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:56.606675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066425e3-2985-4182-8c32-71bbd63fe33d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:56.624047 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-066425e3-2985-4182-8c32-71bbd63fe33d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:18:56.625232 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 494/983] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:18:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:56.631614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfce43-07e6-4b47-8089-d47062d04d88 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:56.640631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfce43-07e6-4b47-8089-d47062d04d88 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:56.645161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542a4a9-282a-4d93-9d30-7c84d669e3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:56.645801 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542a4a9-282a-4d93-9d30-7c84d669e3de admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.646113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542a4a9-282a-4d93-9d30-7c84d669e3de admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.646392 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542a4a9-282a-4d93-9d30-7c84d669e3de admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.647095 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542a4a9-282a-4d93-9d30-7c84d669e3de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:56.647395 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542a4a9-282a-4d93-9d30-7c84d669e3de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:56.648951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542a4a9-282a-4d93-9d30-7c84d669e3de admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:56.660510 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 490/984] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:18:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:56.666471 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066425e3-2985-4182-8c32-71bbd63fe33d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:56.676606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066425e3-2985-4182-8c32-71bbd63fe33d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:56.681021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fb74d-6d47-4159-b524-8fc0a79e25e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:56.681796 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fb74d-6d47-4159-b524-8fc0a79e25e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.682100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fb74d-6d47-4159-b524-8fc0a79e25e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.682369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fb74d-6d47-4159-b524-8fc0a79e25e5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.689028 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fb74d-6d47-4159-b524-8fc0a79e25e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:56.691122 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fb74d-6d47-4159-b524-8fc0a79e25e5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:56.703615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-d21fb74d-6d47-4159-b524-8fc0a79e25e5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:18:56.704980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 495/985] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:18:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:18:56.711488 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542a4a9-282a-4d93-9d30-7c84d669e3de admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:56.722049 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542a4a9-282a-4d93-9d30-7c84d669e3de admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:56.726499 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e2a2-f47c-49ba-9743-61b88035e640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:56.727145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e2a2-f47c-49ba-9743-61b88035e640 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.727426 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e2a2-f47c-49ba-9743-61b88035e640 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.727699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e2a2-f47c-49ba-9743-61b88035e640 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.728474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e2a2-f47c-49ba-9743-61b88035e640 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:56.728781 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e2a2-f47c-49ba-9743-61b88035e640 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:56.730648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e2a2-f47c-49ba-9743-61b88035e640 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:56.743577 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 491/986] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:18:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:56.750112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fb74d-6d47-4159-b524-8fc0a79e25e5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:56.760633 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fb74d-6d47-4159-b524-8fc0a79e25e5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:56.765124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6e54a-60b5-4d7a-9351-79464885985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:56.765768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6e54a-60b5-4d7a-9351-79464885985d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:56.766085 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6e54a-60b5-4d7a-9351-79464885985d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:56.766360 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6e54a-60b5-4d7a-9351-79464885985d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:56.767982 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6e54a-60b5-4d7a-9351-79464885985d admin admin] RBAC: Adding query filter params (role.id=e1eed6eb3c344f43bd3ea8c3751a272f, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=d8c0afa8f09f4923b9c8ab2696156129) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:56.768293 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6e54a-60b5-4d7a-9351-79464885985d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:56.770154 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6e54a-60b5-4d7a-9351-79464885985d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:56.776062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 496/987] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:18:56 2021] GET /identity/v3/role_assignments?user.id=d8c0afa8f09f4923b9c8ab2696156129&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=e1eed6eb3c344f43bd3ea8c3751a272f => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:58.062914 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5f5d5-3305-454e-8a99-44256013a00d None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:58.063429 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5f5d5-3305-454e-8a99-44256013a00d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:58.064047 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5f5d5-3305-454e-8a99-44256013a00d None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:58.066193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 492/988] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:18:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:18:58.072043 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330929b7-1f3b-47af-8e5f-715578b3f13e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:58.072456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330929b7-1f3b-47af-8e5f-715578b3f13e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:58.072598 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330929b7-1f3b-47af-8e5f-715578b3f13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:58.090148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-330929b7-1f3b-47af-8e5f-715578b3f13e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:18:58.091313 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-330929b7-1f3b-47af-8e5f-715578b3f13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:18:58.098950 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 497/989] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:18:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:18:58.122574 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5f5d5-3305-454e-8a99-44256013a00d None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:58.135345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5f5d5-3305-454e-8a99-44256013a00d None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:58.139699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776c672-bbe1-4765-998d-5ef5a17253a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:58.140467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776c672-bbe1-4765-998d-5ef5a17253a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:58.140747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776c672-bbe1-4765-998d-5ef5a17253a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:58.141018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776c672-bbe1-4765-998d-5ef5a17253a7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:58.151536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776c672-bbe1-4765-998d-5ef5a17253a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:18:58.158253 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-3776c672-bbe1-4765-998d-5ef5a17253a7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:18:58.159389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 493/990] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:18:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:18:58.165682 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330929b7-1f3b-47af-8e5f-715578b3f13e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:58.175072 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330929b7-1f3b-47af-8e5f-715578b3f13e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:58.179632 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2156a2-a3fe-4932-93cb-df10420957a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:58.180282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2156a2-a3fe-4932-93cb-df10420957a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:58.180564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2156a2-a3fe-4932-93cb-df10420957a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:58.180839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2156a2-a3fe-4932-93cb-df10420957a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:58.181581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2156a2-a3fe-4932-93cb-df10420957a2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:18:58.181912 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2156a2-a3fe-4932-93cb-df10420957a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:58.183502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2156a2-a3fe-4932-93cb-df10420957a2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:58.192492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 498/991] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:18:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:58.198828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776c672-bbe1-4765-998d-5ef5a17253a7 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:58.212009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776c672-bbe1-4765-998d-5ef5a17253a7 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:58.216457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03302c42-2dbc-4226-9157-1653b6b20f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:58.217291 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03302c42-2dbc-4226-9157-1653b6b20f3d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:58.217563 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03302c42-2dbc-4226-9157-1653b6b20f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:58.217829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03302c42-2dbc-4226-9157-1653b6b20f3d admin admin] PATH_INFO: `/v3/users/072d7266e7384af58901ab6b4ac20dbf` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:58.219033 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03302c42-2dbc-4226-9157-1653b6b20f3d admin admin] RBAC: Authorizing `identity:get_user(user_id=072d7266e7384af58901ab6b4ac20dbf)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:58.221255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03302c42-2dbc-4226-9157-1653b6b20f3d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:58.222832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 494/992] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:18:58 2021] GET /identity/v3/users/072d7266e7384af58901ab6b4ac20dbf => generated 285 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:58.229061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2156a2-a3fe-4932-93cb-df10420957a2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:58.238490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2156a2-a3fe-4932-93cb-df10420957a2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:58.243001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3f4b5-45f5-474f-8eef-d001fbeaf75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:58.243833 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3f4b5-45f5-474f-8eef-d001fbeaf75b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:58.244111 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3f4b5-45f5-474f-8eef-d001fbeaf75b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:58.244381 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3f4b5-45f5-474f-8eef-d001fbeaf75b admin admin] PATH_INFO: `/v3/projects/6c97ccf13c44446abf43db9c4897c198` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:58.245529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3f4b5-45f5-474f-8eef-d001fbeaf75b admin admin] RBAC: Authorizing `identity:get_project(project_id=6c97ccf13c44446abf43db9c4897c198)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:58.247579 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3f4b5-45f5-474f-8eef-d001fbeaf75b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:58.249204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 499/993] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:18:58 2021] GET /identity/v3/projects/6c97ccf13c44446abf43db9c4897c198 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:18:58.255968 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03302c42-2dbc-4226-9157-1653b6b20f3d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:18:58.265375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03302c42-2dbc-4226-9157-1653b6b20f3d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:18:58.270448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329b82f-f9a7-4db7-a921-3b955d707870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:18:58.271283 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329b82f-f9a7-4db7-a921-3b955d707870 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:18:58.271555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329b82f-f9a7-4db7-a921-3b955d707870 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:18:58.271820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329b82f-f9a7-4db7-a921-3b955d707870 admin admin] PATH_INFO: `/v3/projects/6c97ccf13c44446abf43db9c4897c198/users/072d7266e7384af58901ab6b4ac20dbf/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:18:58.273697 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329b82f-f9a7-4db7-a921-3b955d707870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c97ccf13c44446abf43db9c4897c198, user_id=072d7266e7384af58901ab6b4ac20dbf, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:18:58.276278 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329b82f-f9a7-4db7-a921-3b955d707870 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:18:58.345356 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 495/994] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:18:58 2021] PUT /identity/v3/projects/6c97ccf13c44446abf43db9c4897c198/users/072d7266e7384af58901ab6b4ac20dbf/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:19:00.479666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123929c4-3b96-41bf-a87c-b372e59856c2 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:00.480218 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123929c4-3b96-41bf-a87c-b372e59856c2 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:00.480218 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123929c4-3b96-41bf-a87c-b372e59856c2 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:00.482000 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 500/995] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:00.488483 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd39f97-ee04-4273-a457-134479120f17 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:00.488859 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd39f97-ee04-4273-a457-134479120f17 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:00.489025 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd39f97-ee04-4273-a457-134479120f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:00.506512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-1dd39f97-ee04-4273-a457-134479120f17 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:00.507944 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1dd39f97-ee04-4273-a457-134479120f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:00.566982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 496/996] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:19:00.592488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123929c4-3b96-41bf-a87c-b372e59856c2 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:00.604943 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123929c4-3b96-41bf-a87c-b372e59856c2 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:00.609292 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dcfca-6126-4dbf-bfdc-b544c4bc8e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:00.610087 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dcfca-6126-4dbf-bfdc-b544c4bc8e97 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:00.610406 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dcfca-6126-4dbf-bfdc-b544c4bc8e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:00.610683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dcfca-6126-4dbf-bfdc-b544c4bc8e97 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:00.620827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dcfca-6126-4dbf-bfdc-b544c4bc8e97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:19:00.627461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-3b5dcfca-6126-4dbf-bfdc-b544c4bc8e97 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:19:00.628573 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 501/997] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:19:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:19:00.635141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd39f97-ee04-4273-a457-134479120f17 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:00.644513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd39f97-ee04-4273-a457-134479120f17 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:00.648957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb631a-d55d-4afc-bf2c-10bad90ee600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:00.649602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb631a-d55d-4afc-bf2c-10bad90ee600 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:00.649902 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb631a-d55d-4afc-bf2c-10bad90ee600 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:00.650181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb631a-d55d-4afc-bf2c-10bad90ee600 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:00.650916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb631a-d55d-4afc-bf2c-10bad90ee600 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:00.651217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb631a-d55d-4afc-bf2c-10bad90ee600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:00.652812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb631a-d55d-4afc-bf2c-10bad90ee600 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:00.661416 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 497/998] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:19:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:00.667409 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dcfca-6126-4dbf-bfdc-b544c4bc8e97 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:00.676883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dcfca-6126-4dbf-bfdc-b544c4bc8e97 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:00.681288 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac2d23-52c6-40e7-954f-2d78cce9474f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:00.682141 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac2d23-52c6-40e7-954f-2d78cce9474f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:00.682420 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac2d23-52c6-40e7-954f-2d78cce9474f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:00.682696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac2d23-52c6-40e7-954f-2d78cce9474f admin admin] PATH_INFO: `/v3/users/072d7266e7384af58901ab6b4ac20dbf` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:00.683862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac2d23-52c6-40e7-954f-2d78cce9474f admin admin] RBAC: Authorizing `identity:get_user(user_id=072d7266e7384af58901ab6b4ac20dbf)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:00.685981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac2d23-52c6-40e7-954f-2d78cce9474f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:00.687508 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 502/999] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:00 2021] GET /identity/v3/users/072d7266e7384af58901ab6b4ac20dbf => generated 285 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:00.693446 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb631a-d55d-4afc-bf2c-10bad90ee600 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:00.702612 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb631a-d55d-4afc-bf2c-10bad90ee600 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:00.707687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcda1c6-ab8d-425e-9680-9f2074a16d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:00.708302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcda1c6-ab8d-425e-9680-9f2074a16d2c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:00.708581 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcda1c6-ab8d-425e-9680-9f2074a16d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:00.708853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcda1c6-ab8d-425e-9680-9f2074a16d2c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:00.716300 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcda1c6-ab8d-425e-9680-9f2074a16d2c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:00.718035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcda1c6-ab8d-425e-9680-9f2074a16d2c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:00.727142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 498/1000] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:19:00 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:19:00.733075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac2d23-52c6-40e7-954f-2d78cce9474f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:00.742145 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac2d23-52c6-40e7-954f-2d78cce9474f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:00.746548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcf94b-7773-4bd7-a73a-27dfc519ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:00.747344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf94b-7773-4bd7-a73a-27dfc519ea10 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:00.747621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf94b-7773-4bd7-a73a-27dfc519ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:00.747890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf94b-7773-4bd7-a73a-27dfc519ea10 admin admin] PATH_INFO: `/v3/projects/6c97ccf13c44446abf43db9c4897c198` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:00.749007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcf94b-7773-4bd7-a73a-27dfc519ea10 admin admin] RBAC: Authorizing `identity:get_project(project_id=6c97ccf13c44446abf43db9c4897c198)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:00.751119 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcf94b-7773-4bd7-a73a-27dfc519ea10 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:00.752704 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 503/1001] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:19:00 2021] GET /identity/v3/projects/6c97ccf13c44446abf43db9c4897c198 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:00.758936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcda1c6-ab8d-425e-9680-9f2074a16d2c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:00.767899 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcda1c6-ab8d-425e-9680-9f2074a16d2c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:00.772435 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81483e8d-d717-4ecc-9998-c86705c333f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:00.773049 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81483e8d-d717-4ecc-9998-c86705c333f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:00.773331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81483e8d-d717-4ecc-9998-c86705c333f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:00.773609 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81483e8d-d717-4ecc-9998-c86705c333f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:00.774448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81483e8d-d717-4ecc-9998-c86705c333f7 admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=6c97ccf13c44446abf43db9c4897c198, user.id=072d7266e7384af58901ab6b4ac20dbf) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:00.774757 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81483e8d-d717-4ecc-9998-c86705c333f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:00.776573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81483e8d-d717-4ecc-9998-c86705c333f7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:00.782164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 499/1002] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:19:00 2021] GET /identity/v3/role_assignments?user.id=072d7266e7384af58901ab6b4ac20dbf&scope.project.id=6c97ccf13c44446abf43db9c4897c198&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:02.964591 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73bf57-eae9-4890-aa2a-01afc1999918 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:02.965041 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73bf57-eae9-4890-aa2a-01afc1999918 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:02.965133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73bf57-eae9-4890-aa2a-01afc1999918 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:02.966912 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 504/1003] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:02.973135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd4abc-ddf0-4c86-8182-549c1460c5f3 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:02.973569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd4abc-ddf0-4c86-8182-549c1460c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:02.973664 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd4abc-ddf0-4c86-8182-549c1460c5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:02.991550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-b0bd4abc-ddf0-4c86-8182-549c1460c5f3 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:02.992721 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b0bd4abc-ddf0-4c86-8182-549c1460c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:03.000181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 500/1004] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:19:03.026358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73bf57-eae9-4890-aa2a-01afc1999918 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:03.038264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73bf57-eae9-4890-aa2a-01afc1999918 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:03.042518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fc3e7-c48c-4725-af1b-e5a3cb7fa28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:03.043281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fc3e7-c48c-4725-af1b-e5a3cb7fa28b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:03.043558 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fc3e7-c48c-4725-af1b-e5a3cb7fa28b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:03.043830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fc3e7-c48c-4725-af1b-e5a3cb7fa28b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:03.044961 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fc3e7-c48c-4725-af1b-e5a3cb7fa28b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:03.046650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fc3e7-c48c-4725-af1b-e5a3cb7fa28b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:03.048833 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 505/1005] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:19:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:03.054806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd4abc-ddf0-4c86-8182-549c1460c5f3 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:03.063992 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd4abc-ddf0-4c86-8182-549c1460c5f3 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:03.068451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ce4eb-5bdf-430b-a80e-7f13518adffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:03.069089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ce4eb-5bdf-430b-a80e-7f13518adffd admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:03.069365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ce4eb-5bdf-430b-a80e-7f13518adffd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:03.069630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ce4eb-5bdf-430b-a80e-7f13518adffd admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:03.070352 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ce4eb-5bdf-430b-a80e-7f13518adffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:03.072202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ce4eb-5bdf-430b-a80e-7f13518adffd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:03.202782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 501/1006] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:19:03 2021] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:19:05.365555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf14b52-26b0-45b8-8df9-1b9ef84d6ab3 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:05.366110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf14b52-26b0-45b8-8df9-1b9ef84d6ab3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:05.366110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf14b52-26b0-45b8-8df9-1b9ef84d6ab3 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:05.367863 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 506/1007] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:05.373803 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b28285-a99f-41ba-88e4-c43f6bf54c37 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:05.374254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b28285-a99f-41ba-88e4-c43f6bf54c37 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:05.374380 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b28285-a99f-41ba-88e4-c43f6bf54c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:05.392835 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-69b28285-a99f-41ba-88e4-c43f6bf54c37 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:05.394048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-69b28285-a99f-41ba-88e4-c43f6bf54c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:05.401594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 502/1008] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:05 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:19:05.426198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf14b52-26b0-45b8-8df9-1b9ef84d6ab3 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:05.438589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf14b52-26b0-45b8-8df9-1b9ef84d6ab3 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:05.442985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c31df-64ce-4d01-8674-4f52ec0c15ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:05.443817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c31df-64ce-4d01-8674-4f52ec0c15ef admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:05.444095 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c31df-64ce-4d01-8674-4f52ec0c15ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:05.444367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c31df-64ce-4d01-8674-4f52ec0c15ef admin admin] PATH_INFO: `/v3/roles/8f120e43ae5140dbbe6dbdf88980fabe` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:05.445794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c31df-64ce-4d01-8674-4f52ec0c15ef admin admin] RBAC: Authorizing `identity:get_role(role_id=8f120e43ae5140dbbe6dbdf88980fabe)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:05.446827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-d84c31df-64ce-4d01-8674-4f52ec0c15ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:19:05.446827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:19:05.446827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:19:05.447690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c31df-64ce-4d01-8674-4f52ec0c15ef admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:05.449002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 507/1009] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:05 2021] GET /identity/v3/roles/8f120e43ae5140dbbe6dbdf88980fabe => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:05.455670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b28285-a99f-41ba-88e4-c43f6bf54c37 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:05.464228 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b28285-a99f-41ba-88e4-c43f6bf54c37 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:05.468698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbde7f-9ad8-4030-bf8b-fe6fd8052e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:05.469588 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbde7f-9ad8-4030-bf8b-fe6fd8052e22 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:05.469883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbde7f-9ad8-4030-bf8b-fe6fd8052e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:05.470157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbde7f-9ad8-4030-bf8b-fe6fd8052e22 admin admin] PATH_INFO: `/v3/users/4c105306e49c4a0aba28a4df9939ff8a` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:05.482846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbde7f-9ad8-4030-bf8b-fe6fd8052e22 admin admin] RBAC: Authorizing `identity:get_user(user_id=4c105306e49c4a0aba28a4df9939ff8a)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:05.484995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbde7f-9ad8-4030-bf8b-fe6fd8052e22 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:05.486616 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 503/1010] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:05 2021] GET /identity/v3/users/4c105306e49c4a0aba28a4df9939ff8a => generated 286 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:05.492499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c31df-64ce-4d01-8674-4f52ec0c15ef admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:05.502397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c31df-64ce-4d01-8674-4f52ec0c15ef admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:05.507078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12e6e8-4ca0-428f-b60b-b5b01b13c4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:05.507693 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12e6e8-4ca0-428f-b60b-b5b01b13c4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:05.507973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12e6e8-4ca0-428f-b60b-b5b01b13c4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:05.508246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12e6e8-4ca0-428f-b60b-b5b01b13c4f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:05.515701 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12e6e8-4ca0-428f-b60b-b5b01b13c4f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:05.518087 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12e6e8-4ca0-428f-b60b-b5b01b13c4f7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:05.526591 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 508/1011] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:19:05 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:19:05.532897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbde7f-9ad8-4030-bf8b-fe6fd8052e22 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:05.542366 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbde7f-9ad8-4030-bf8b-fe6fd8052e22 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:05.546827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e751949-df4d-461d-a880-4f088f796a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:05.547659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e751949-df4d-461d-a880-4f088f796a0f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:05.547935 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e751949-df4d-461d-a880-4f088f796a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:05.548207 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e751949-df4d-461d-a880-4f088f796a0f admin admin] PATH_INFO: `/v3/projects/6c97ccf13c44446abf43db9c4897c198` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:05.549342 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e751949-df4d-461d-a880-4f088f796a0f admin admin] RBAC: Authorizing `identity:get_project(project_id=6c97ccf13c44446abf43db9c4897c198)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:05.551372 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e751949-df4d-461d-a880-4f088f796a0f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:05.552962 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 504/1012] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:19:05 2021] GET /identity/v3/projects/6c97ccf13c44446abf43db9c4897c198 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:05.559160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12e6e8-4ca0-428f-b60b-b5b01b13c4f7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:05.568207 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12e6e8-4ca0-428f-b60b-b5b01b13c4f7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:05.572640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bae62c-9b7c-4101-86f9-9ed694b900b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:05.573253 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae62c-9b7c-4101-86f9-9ed694b900b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:05.573528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae62c-9b7c-4101-86f9-9ed694b900b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:05.573797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae62c-9b7c-4101-86f9-9ed694b900b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:05.574631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bae62c-9b7c-4101-86f9-9ed694b900b8 admin admin] RBAC: Adding query filter params (role.id=8f120e43ae5140dbbe6dbdf88980fabe, scope.project.id=6c97ccf13c44446abf43db9c4897c198, user.id=4c105306e49c4a0aba28a4df9939ff8a) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:05.574935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bae62c-9b7c-4101-86f9-9ed694b900b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:05.576708 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bae62c-9b7c-4101-86f9-9ed694b900b8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:05.582361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 509/1013] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:19:05 2021] GET /identity/v3/role_assignments?user.id=4c105306e49c4a0aba28a4df9939ff8a&scope.project.id=6c97ccf13c44446abf43db9c4897c198&role.id=8f120e43ae5140dbbe6dbdf88980fabe => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:07.699718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da60b7-ac36-43a3-bfa8-4e097dd9e88a None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:07.700271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da60b7-ac36-43a3-bfa8-4e097dd9e88a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:07.700365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da60b7-ac36-43a3-bfa8-4e097dd9e88a None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:07.702096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 505/1014] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:07.708143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd53b3b-1cb8-4f80-b92a-bf15a5e3f1bb None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:07.708567 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd53b3b-1cb8-4f80-b92a-bf15a5e3f1bb None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:07.708698 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd53b3b-1cb8-4f80-b92a-bf15a5e3f1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:07.726872 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-6bd53b3b-1cb8-4f80-b92a-bf15a5e3f1bb None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:07.728058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-6bd53b3b-1cb8-4f80-b92a-bf15a5e3f1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:07.736544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 510/1015] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:19:07.760191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da60b7-ac36-43a3-bfa8-4e097dd9e88a None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:07.772569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da60b7-ac36-43a3-bfa8-4e097dd9e88a None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:07.776828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cc183-3d37-46d0-aecb-ad406afcfdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:07.777651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cc183-3d37-46d0-aecb-ad406afcfdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:07.777959 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cc183-3d37-46d0-aecb-ad406afcfdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:07.778232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cc183-3d37-46d0-aecb-ad406afcfdf2 admin admin] PATH_INFO: `/v3/roles/8f120e43ae5140dbbe6dbdf88980fabe` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:07.779655 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cc183-3d37-46d0-aecb-ad406afcfdf2 admin admin] RBAC: Authorizing `identity:get_role(role_id=8f120e43ae5140dbbe6dbdf88980fabe)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:07.780641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-947cc183-3d37-46d0-aecb-ad406afcfdf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:19:07.780641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:19:07.780641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:19:07.781507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cc183-3d37-46d0-aecb-ad406afcfdf2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:07.783413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 506/1016] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:07 2021] GET /identity/v3/roles/8f120e43ae5140dbbe6dbdf88980fabe => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:07.789544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd53b3b-1cb8-4f80-b92a-bf15a5e3f1bb None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:07.800016 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd53b3b-1cb8-4f80-b92a-bf15a5e3f1bb None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:07.804545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00539178-f403-490e-811d-2be56338cd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:07.805396 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00539178-f403-490e-811d-2be56338cd69 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:07.805681 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00539178-f403-490e-811d-2be56338cd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:07.805996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00539178-f403-490e-811d-2be56338cd69 admin admin] PATH_INFO: `/v3/users/4c105306e49c4a0aba28a4df9939ff8a` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:07.807188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00539178-f403-490e-811d-2be56338cd69 admin admin] RBAC: Authorizing `identity:get_user(user_id=4c105306e49c4a0aba28a4df9939ff8a)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:07.809295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00539178-f403-490e-811d-2be56338cd69 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:07.810894 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 511/1017] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:07 2021] GET /identity/v3/users/4c105306e49c4a0aba28a4df9939ff8a => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:07.816763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cc183-3d37-46d0-aecb-ad406afcfdf2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:07.825825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cc183-3d37-46d0-aecb-ad406afcfdf2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:07.830255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471d238-8b86-4a37-9560-6ae96efaa21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:07.831051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d238-8b86-4a37-9560-6ae96efaa21b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:07.831331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d238-8b86-4a37-9560-6ae96efaa21b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:07.831599 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d238-8b86-4a37-9560-6ae96efaa21b admin admin] PATH_INFO: `/v3/projects/6c97ccf13c44446abf43db9c4897c198` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:07.832715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471d238-8b86-4a37-9560-6ae96efaa21b admin admin] RBAC: Authorizing `identity:get_project(project_id=6c97ccf13c44446abf43db9c4897c198)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:07.834716 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471d238-8b86-4a37-9560-6ae96efaa21b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:07.836281 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 507/1018] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:19:07 2021] GET /identity/v3/projects/6c97ccf13c44446abf43db9c4897c198 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:07.842277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00539178-f403-490e-811d-2be56338cd69 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:07.853332 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00539178-f403-490e-811d-2be56338cd69 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:07.857780 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c51d80-00f5-4349-a73a-3b9bf9527a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:07.858656 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51d80-00f5-4349-a73a-3b9bf9527a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:07.858938 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51d80-00f5-4349-a73a-3b9bf9527a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:07.859220 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51d80-00f5-4349-a73a-3b9bf9527a74 admin admin] PATH_INFO: `/v3/projects/6c97ccf13c44446abf43db9c4897c198/users/4c105306e49c4a0aba28a4df9939ff8a/roles/8f120e43ae5140dbbe6dbdf88980fabe` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:07.862456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c51d80-00f5-4349-a73a-3b9bf9527a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c97ccf13c44446abf43db9c4897c198, user_id=4c105306e49c4a0aba28a4df9939ff8a, role_id=8f120e43ae5140dbbe6dbdf88980fabe)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:07.865055 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c51d80-00f5-4349-a73a-3b9bf9527a74 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:07.937361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 512/1019] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:19:07 2021] PUT /identity/v3/projects/6c97ccf13c44446abf43db9c4897c198/users/4c105306e49c4a0aba28a4df9939ff8a/roles/8f120e43ae5140dbbe6dbdf88980fabe => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:19:10.028707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab299055-ae56-43a0-a1e0-caa44c018a76 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:10.029225 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab299055-ae56-43a0-a1e0-caa44c018a76 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:10.029225 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab299055-ae56-43a0-a1e0-caa44c018a76 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:10.031011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 508/1020] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:10.037486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4d1f5-664f-4c35-8a42-8229b0c88da5 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:10.037918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4d1f5-664f-4c35-8a42-8229b0c88da5 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:10.038067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4d1f5-664f-4c35-8a42-8229b0c88da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:10.055672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c2f4d1f5-664f-4c35-8a42-8229b0c88da5 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:10.056851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c2f4d1f5-664f-4c35-8a42-8229b0c88da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:10.111523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 513/1021] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:19:10.136291 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab299055-ae56-43a0-a1e0-caa44c018a76 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:10.148427 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab299055-ae56-43a0-a1e0-caa44c018a76 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:10.152727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6310f0-504f-4eb7-87c6-99c5d50f8642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:10.153548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6310f0-504f-4eb7-87c6-99c5d50f8642 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:10.153822 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6310f0-504f-4eb7-87c6-99c5d50f8642 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:10.154117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6310f0-504f-4eb7-87c6-99c5d50f8642 admin admin] PATH_INFO: `/v3/roles/8f120e43ae5140dbbe6dbdf88980fabe` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:10.155537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6310f0-504f-4eb7-87c6-99c5d50f8642 admin admin] RBAC: Authorizing `identity:get_role(role_id=8f120e43ae5140dbbe6dbdf88980fabe)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:10.157728 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6310f0-504f-4eb7-87c6-99c5d50f8642 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:10.159040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 509/1022] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:10 2021] GET /identity/v3/roles/8f120e43ae5140dbbe6dbdf88980fabe => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:10.165280 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4d1f5-664f-4c35-8a42-8229b0c88da5 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:10.174716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4d1f5-664f-4c35-8a42-8229b0c88da5 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:10.179190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798429f-5eaa-4a5e-b07d-1b3e878e0983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:10.180030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798429f-5eaa-4a5e-b07d-1b3e878e0983 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:10.180306 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798429f-5eaa-4a5e-b07d-1b3e878e0983 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:10.180573 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798429f-5eaa-4a5e-b07d-1b3e878e0983 admin admin] PATH_INFO: `/v3/users/4c105306e49c4a0aba28a4df9939ff8a` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:10.181748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798429f-5eaa-4a5e-b07d-1b3e878e0983 admin admin] RBAC: Authorizing `identity:get_user(user_id=4c105306e49c4a0aba28a4df9939ff8a)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:10.183895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798429f-5eaa-4a5e-b07d-1b3e878e0983 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:10.185448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 514/1023] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:10 2021] GET /identity/v3/users/4c105306e49c4a0aba28a4df9939ff8a => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:10.191969 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6310f0-504f-4eb7-87c6-99c5d50f8642 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:10.201319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6310f0-504f-4eb7-87c6-99c5d50f8642 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:10.205783 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a687c39-63df-4464-b49a-378cac63ea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:10.206364 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a687c39-63df-4464-b49a-378cac63ea16 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:10.206641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a687c39-63df-4464-b49a-378cac63ea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:10.206912 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a687c39-63df-4464-b49a-378cac63ea16 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:10.214236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a687c39-63df-4464-b49a-378cac63ea16 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:10.215912 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a687c39-63df-4464-b49a-378cac63ea16 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:10.225028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 510/1024] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:19:10 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:19:10.231051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798429f-5eaa-4a5e-b07d-1b3e878e0983 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:10.240757 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798429f-5eaa-4a5e-b07d-1b3e878e0983 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:10.245201 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1780c-930f-425f-b0ae-440d97549e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:10.246052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1780c-930f-425f-b0ae-440d97549e42 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:10.246336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1780c-930f-425f-b0ae-440d97549e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:10.246611 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1780c-930f-425f-b0ae-440d97549e42 admin admin] PATH_INFO: `/v3/projects/6c97ccf13c44446abf43db9c4897c198` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:10.247752 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1780c-930f-425f-b0ae-440d97549e42 admin admin] RBAC: Authorizing `identity:get_project(project_id=6c97ccf13c44446abf43db9c4897c198)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:10.249723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1780c-930f-425f-b0ae-440d97549e42 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:10.251569 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 515/1025] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:19:10 2021] GET /identity/v3/projects/6c97ccf13c44446abf43db9c4897c198 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:10.257849 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a687c39-63df-4464-b49a-378cac63ea16 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:10.266549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a687c39-63df-4464-b49a-378cac63ea16 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:10.271001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac4522-a814-4894-bfad-a9e2c5c73bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:10.271605 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4522-a814-4894-bfad-a9e2c5c73bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:10.271879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4522-a814-4894-bfad-a9e2c5c73bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:10.272145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4522-a814-4894-bfad-a9e2c5c73bf4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:10.272938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac4522-a814-4894-bfad-a9e2c5c73bf4 admin admin] RBAC: Adding query filter params (role.id=8f120e43ae5140dbbe6dbdf88980fabe, scope.project.id=6c97ccf13c44446abf43db9c4897c198, user.id=4c105306e49c4a0aba28a4df9939ff8a) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:10.273239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac4522-a814-4894-bfad-a9e2c5c73bf4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:10.275028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac4522-a814-4894-bfad-a9e2c5c73bf4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:10.280587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 511/1026] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:19:10 2021] GET /identity/v3/role_assignments?user.id=4c105306e49c4a0aba28a4df9939ff8a&scope.project.id=6c97ccf13c44446abf43db9c4897c198&role.id=8f120e43ae5140dbbe6dbdf88980fabe => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:12.427542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200edebe-8b41-4885-a111-71e8662d3fa3 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:12.428065 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200edebe-8b41-4885-a111-71e8662d3fa3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:12.428065 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200edebe-8b41-4885-a111-71e8662d3fa3 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:12.429835 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 516/1027] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:12.435663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4a0cd-4356-48aa-99ec-69dc8f68ce86 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:12.436057 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4a0cd-4356-48aa-99ec-69dc8f68ce86 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:12.436209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4a0cd-4356-48aa-99ec-69dc8f68ce86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:12.454331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-1dc4a0cd-4356-48aa-99ec-69dc8f68ce86 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:12.455490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1dc4a0cd-4356-48aa-99ec-69dc8f68ce86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:12.462868 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 512/1028] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:19:12.486838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200edebe-8b41-4885-a111-71e8662d3fa3 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:12.498845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200edebe-8b41-4885-a111-71e8662d3fa3 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:12.504378 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ab3cf-86cf-4045-9f99-124a3706178a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:12.505154 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ab3cf-86cf-4045-9f99-124a3706178a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:12.505434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ab3cf-86cf-4045-9f99-124a3706178a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:12.505709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ab3cf-86cf-4045-9f99-124a3706178a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:12.507165 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ab3cf-86cf-4045-9f99-124a3706178a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:12.508836 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ab3cf-86cf-4045-9f99-124a3706178a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:12.510470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 517/1029] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:19:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:12.518600 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4a0cd-4356-48aa-99ec-69dc8f68ce86 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:12.529522 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4a0cd-4356-48aa-99ec-69dc8f68ce86 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:12.534646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305beb7-5dbb-4b54-96c7-376f1205381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:12.535292 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305beb7-5dbb-4b54-96c7-376f1205381c admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:12.535574 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305beb7-5dbb-4b54-96c7-376f1205381c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:12.535847 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305beb7-5dbb-4b54-96c7-376f1205381c admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:12.536542 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305beb7-5dbb-4b54-96c7-376f1205381c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:12.538464 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305beb7-5dbb-4b54-96c7-376f1205381c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:12.661428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 513/1030] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:19:12 2021] POST /identity/v3/projects => generated 311 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:19:14.858681 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4139c60-f02d-4822-a6b8-214b483c8ab3 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:14.859258 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4139c60-f02d-4822-a6b8-214b483c8ab3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:14.859355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4139c60-f02d-4822-a6b8-214b483c8ab3 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:14.861191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 518/1031] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:14.867282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f009-083b-4bbb-9574-4048fb150db6 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:14.867693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f009-083b-4bbb-9574-4048fb150db6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:14.867831 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f009-083b-4bbb-9574-4048fb150db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:14.885365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-81d5f009-083b-4bbb-9574-4048fb150db6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:14.886567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-81d5f009-083b-4bbb-9574-4048fb150db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:14.944538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 514/1032] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:19:14.971342 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4139c60-f02d-4822-a6b8-214b483c8ab3 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:14.983166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4139c60-f02d-4822-a6b8-214b483c8ab3 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:14.987527 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911aecae-8cae-428f-9d68-2b188e469d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:14.988294 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aecae-8cae-428f-9d68-2b188e469d62 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:14.988574 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aecae-8cae-428f-9d68-2b188e469d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:14.988847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aecae-8cae-428f-9d68-2b188e469d62 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:14.990023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aecae-8cae-428f-9d68-2b188e469d62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:14.991690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aecae-8cae-428f-9d68-2b188e469d62 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:14.993244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 519/1033] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:19:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:14.999275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f009-083b-4bbb-9574-4048fb150db6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:15.008102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f009-083b-4bbb-9574-4048fb150db6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:15.012537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef858e-762a-4cc8-bfd7-77f57561d0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:15.013183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef858e-762a-4cc8-bfd7-77f57561d0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:15.013462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef858e-762a-4cc8-bfd7-77f57561d0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:15.013736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef858e-762a-4cc8-bfd7-77f57561d0d9 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:15.014466 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef858e-762a-4cc8-bfd7-77f57561d0d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:15.016945 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef858e-762a-4cc8-bfd7-77f57561d0d9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:15.099178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 515/1034] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:19:14 2021] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:19:17.302222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220598b-6e46-490b-a016-90914b3aaf0e None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:17.302818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220598b-6e46-490b-a016-90914b3aaf0e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:17.302818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220598b-6e46-490b-a016-90914b3aaf0e None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:17.304606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 520/1035] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:17.310661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3859c-996e-4dab-b900-e158eb3e61df None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:17.311107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3859c-996e-4dab-b900-e158eb3e61df None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:17.311206 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3859c-996e-4dab-b900-e158eb3e61df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:17.328933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-4fb3859c-996e-4dab-b900-e158eb3e61df None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:17.330136 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4fb3859c-996e-4dab-b900-e158eb3e61df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:17.337591 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 516/1036] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:19:17.362419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220598b-6e46-490b-a016-90914b3aaf0e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:17.374110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220598b-6e46-490b-a016-90914b3aaf0e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:17.378501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e887a3d-a733-4eac-8f79-13898853c2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:17.379259 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e887a3d-a733-4eac-8f79-13898853c2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:17.379535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e887a3d-a733-4eac-8f79-13898853c2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:17.379801 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e887a3d-a733-4eac-8f79-13898853c2a5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:17.389721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e887a3d-a733-4eac-8f79-13898853c2a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:19:17.397149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-2e887a3d-a733-4eac-8f79-13898853c2a5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:19:17.398297 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 521/1037] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:19:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:19:17.404652 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3859c-996e-4dab-b900-e158eb3e61df None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:17.414249 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3859c-996e-4dab-b900-e158eb3e61df None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:17.418730 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68787eb0-4f31-43b7-be64-85f5a03a2c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:17.419375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787eb0-4f31-43b7-be64-85f5a03a2c55 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:17.419652 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787eb0-4f31-43b7-be64-85f5a03a2c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:17.419921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787eb0-4f31-43b7-be64-85f5a03a2c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:17.420651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68787eb0-4f31-43b7-be64-85f5a03a2c55 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:17.420953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68787eb0-4f31-43b7-be64-85f5a03a2c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:17.422676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68787eb0-4f31-43b7-be64-85f5a03a2c55 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:17.430556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 517/1038] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:19:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:17.436694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e887a3d-a733-4eac-8f79-13898853c2a5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:17.447120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e887a3d-a733-4eac-8f79-13898853c2a5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:17.451530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee628926-eef1-4ebd-ad9e-e490212154a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:17.452357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee628926-eef1-4ebd-ad9e-e490212154a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:17.452630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee628926-eef1-4ebd-ad9e-e490212154a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:17.452979 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee628926-eef1-4ebd-ad9e-e490212154a0 admin admin] PATH_INFO: `/v3/users/c56a49935940457d8fb6fa79a556c97b` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:17.465541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee628926-eef1-4ebd-ad9e-e490212154a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=c56a49935940457d8fb6fa79a556c97b)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:17.467680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee628926-eef1-4ebd-ad9e-e490212154a0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:17.469795 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 522/1039] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:17 2021] GET /identity/v3/users/c56a49935940457d8fb6fa79a556c97b => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:17.475952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68787eb0-4f31-43b7-be64-85f5a03a2c55 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:17.485780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68787eb0-4f31-43b7-be64-85f5a03a2c55 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:17.490230 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232ed1c-53f5-4f02-ba13-2168d30bcd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:17.490875 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232ed1c-53f5-4f02-ba13-2168d30bcd27 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:17.491156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232ed1c-53f5-4f02-ba13-2168d30bcd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:17.491432 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232ed1c-53f5-4f02-ba13-2168d30bcd27 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:17.498870 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232ed1c-53f5-4f02-ba13-2168d30bcd27 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:17.500612 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232ed1c-53f5-4f02-ba13-2168d30bcd27 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:17.509397 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 518/1040] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:19:17 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:19:17.515548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee628926-eef1-4ebd-ad9e-e490212154a0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:17.524640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee628926-eef1-4ebd-ad9e-e490212154a0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:17.529100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b052017-5a51-458a-aa56-6a251687acb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:17.529940 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b052017-5a51-458a-aa56-6a251687acb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:17.530221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b052017-5a51-458a-aa56-6a251687acb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:17.530489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b052017-5a51-458a-aa56-6a251687acb4 admin admin] PATH_INFO: `/v3/projects/b96566913c3d4ce3b681e68bbcb26824` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:17.532182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b052017-5a51-458a-aa56-6a251687acb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=b96566913c3d4ce3b681e68bbcb26824)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:17.534194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b052017-5a51-458a-aa56-6a251687acb4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:17.535790 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 523/1041] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:19:17 2021] GET /identity/v3/projects/b96566913c3d4ce3b681e68bbcb26824 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:17.542029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232ed1c-53f5-4f02-ba13-2168d30bcd27 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:17.551540 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232ed1c-53f5-4f02-ba13-2168d30bcd27 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:17.556128 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64e0e5-9d31-423d-8fd9-4b7aedfbafff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:17.556706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64e0e5-9d31-423d-8fd9-4b7aedfbafff admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:17.556987 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64e0e5-9d31-423d-8fd9-4b7aedfbafff admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:17.557263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64e0e5-9d31-423d-8fd9-4b7aedfbafff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:17.558122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64e0e5-9d31-423d-8fd9-4b7aedfbafff admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=b96566913c3d4ce3b681e68bbcb26824, user.id=c56a49935940457d8fb6fa79a556c97b) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:17.558434 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64e0e5-9d31-423d-8fd9-4b7aedfbafff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:17.560214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64e0e5-9d31-423d-8fd9-4b7aedfbafff admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:17.566123 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 519/1042] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:19:17 2021] GET /identity/v3/role_assignments?user.id=c56a49935940457d8fb6fa79a556c97b&scope.project.id=b96566913c3d4ce3b681e68bbcb26824&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:19.654519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f51a98-8151-4b4b-a050-9a6fe6fa851b None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:19.655077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f51a98-8151-4b4b-a050-9a6fe6fa851b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:19.655077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f51a98-8151-4b4b-a050-9a6fe6fa851b None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:19.657366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 524/1043] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:19.663254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0eb9e-70df-43d6-842a-40c09f325f2a None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:19.663651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0eb9e-70df-43d6-842a-40c09f325f2a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:19.663802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0eb9e-70df-43d6-842a-40c09f325f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:19.681323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-04d0eb9e-70df-43d6-842a-40c09f325f2a None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:19.682538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-04d0eb9e-70df-43d6-842a-40c09f325f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:19.690094 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 520/1044] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:19:19.713215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f51a98-8151-4b4b-a050-9a6fe6fa851b None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:19.725433 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f51a98-8151-4b4b-a050-9a6fe6fa851b None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:19.729676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9baef-fa26-408b-9d1e-cc798075942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:19.730459 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9baef-fa26-408b-9d1e-cc798075942b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:19.730739 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9baef-fa26-408b-9d1e-cc798075942b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:19.731011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9baef-fa26-408b-9d1e-cc798075942b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:19.741639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9baef-fa26-408b-9d1e-cc798075942b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:19:19.748554 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-07c9baef-fa26-408b-9d1e-cc798075942b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:19:19.749733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 525/1045] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:19:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:19:19.756692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0eb9e-70df-43d6-842a-40c09f325f2a None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:19.765547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0eb9e-70df-43d6-842a-40c09f325f2a None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:19.770064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a82692-5716-43e9-971e-b2d0e3249857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:19.770713 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a82692-5716-43e9-971e-b2d0e3249857 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:19.770992 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a82692-5716-43e9-971e-b2d0e3249857 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:19.771265 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a82692-5716-43e9-971e-b2d0e3249857 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:19.772001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a82692-5716-43e9-971e-b2d0e3249857 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:19.772305 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a82692-5716-43e9-971e-b2d0e3249857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:19.773889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a82692-5716-43e9-971e-b2d0e3249857 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:19.782233 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 521/1046] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:19:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:19.788174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9baef-fa26-408b-9d1e-cc798075942b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:19.798677 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9baef-fa26-408b-9d1e-cc798075942b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:19.803084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3989d9-00b5-413e-91f9-93f1beb81ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:19.803909 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3989d9-00b5-413e-91f9-93f1beb81ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:19.804186 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3989d9-00b5-413e-91f9-93f1beb81ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:19.804456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3989d9-00b5-413e-91f9-93f1beb81ca5 admin admin] PATH_INFO: `/v3/users/c56a49935940457d8fb6fa79a556c97b` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:19.805617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3989d9-00b5-413e-91f9-93f1beb81ca5 admin admin] RBAC: Authorizing `identity:get_user(user_id=c56a49935940457d8fb6fa79a556c97b)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:19.807732 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3989d9-00b5-413e-91f9-93f1beb81ca5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:19.809259 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 526/1047] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:19 2021] GET /identity/v3/users/c56a49935940457d8fb6fa79a556c97b => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:19.815296 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a82692-5716-43e9-971e-b2d0e3249857 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:19.824461 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a82692-5716-43e9-971e-b2d0e3249857 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:19.828942 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbadbda-9bf6-491d-8f82-0a8b71f3f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:19.829758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbadbda-9bf6-491d-8f82-0a8b71f3f10b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:19.830072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbadbda-9bf6-491d-8f82-0a8b71f3f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:19.830344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbadbda-9bf6-491d-8f82-0a8b71f3f10b admin admin] PATH_INFO: `/v3/projects/b96566913c3d4ce3b681e68bbcb26824` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:19.831478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbadbda-9bf6-491d-8f82-0a8b71f3f10b admin admin] RBAC: Authorizing `identity:get_project(project_id=b96566913c3d4ce3b681e68bbcb26824)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:19.833464 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbadbda-9bf6-491d-8f82-0a8b71f3f10b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:19.835080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 522/1048] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:19:19 2021] GET /identity/v3/projects/b96566913c3d4ce3b681e68bbcb26824 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:19.841112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3989d9-00b5-413e-91f9-93f1beb81ca5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:19.850797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3989d9-00b5-413e-91f9-93f1beb81ca5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:19.855302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bd683-919b-40d5-a613-17c3c100896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:19.856138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bd683-919b-40d5-a613-17c3c100896a admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:19.856417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bd683-919b-40d5-a613-17c3c100896a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:19.856688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bd683-919b-40d5-a613-17c3c100896a admin admin] PATH_INFO: `/v3/projects/b96566913c3d4ce3b681e68bbcb26824/users/c56a49935940457d8fb6fa79a556c97b/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:19.858618 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bd683-919b-40d5-a613-17c3c100896a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96566913c3d4ce3b681e68bbcb26824, user_id=c56a49935940457d8fb6fa79a556c97b, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:19.861764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bd683-919b-40d5-a613-17c3c100896a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:20.008530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 527/1049] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:19:19 2021] PUT /identity/v3/projects/b96566913c3d4ce3b681e68bbcb26824/users/c56a49935940457d8fb6fa79a556c97b/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:19:22.132872 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38715-a2c5-4446-8a39-7b2b2440e47e None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:22.133390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38715-a2c5-4446-8a39-7b2b2440e47e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:22.133390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38715-a2c5-4446-8a39-7b2b2440e47e None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:22.135175 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 523/1050] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:22.141255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbb88f-ed36-404b-8849-939da1c4d293 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:22.141675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbb88f-ed36-404b-8849-939da1c4d293 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:22.141809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbb88f-ed36-404b-8849-939da1c4d293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:22.159238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-ebfbb88f-ed36-404b-8849-939da1c4d293 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:22.160397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ebfbb88f-ed36-404b-8849-939da1c4d293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:22.214260 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 528/1051] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:19:22.238797 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38715-a2c5-4446-8a39-7b2b2440e47e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:22.251007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38715-a2c5-4446-8a39-7b2b2440e47e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:22.255248 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddfd1c-c875-4e8f-b169-4660c2f90ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:22.256270 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddfd1c-c875-4e8f-b169-4660c2f90ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:22.256618 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddfd1c-c875-4e8f-b169-4660c2f90ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:22.256888 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddfd1c-c875-4e8f-b169-4660c2f90ad1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:22.268353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddfd1c-c875-4e8f-b169-4660c2f90ad1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:19:22.276283 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-4fddfd1c-c875-4e8f-b169-4660c2f90ad1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:19:22.277464 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 524/1052] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:19:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:19:22.285387 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbb88f-ed36-404b-8849-939da1c4d293 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:22.294169 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbb88f-ed36-404b-8849-939da1c4d293 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:22.299506 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89692a7-d0db-418e-bfb9-2204c3aaa73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:22.300150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89692a7-d0db-418e-bfb9-2204c3aaa73d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:22.300428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89692a7-d0db-418e-bfb9-2204c3aaa73d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:22.300699 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89692a7-d0db-418e-bfb9-2204c3aaa73d admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:22.301425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89692a7-d0db-418e-bfb9-2204c3aaa73d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:22.301724 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89692a7-d0db-418e-bfb9-2204c3aaa73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:22.303337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89692a7-d0db-418e-bfb9-2204c3aaa73d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:22.311347 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 529/1053] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:19:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:19:22.318132 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddfd1c-c875-4e8f-b169-4660c2f90ad1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:22.328706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddfd1c-c875-4e8f-b169-4660c2f90ad1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:22.333209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4c918-d7e5-4e08-921d-a67bdd1dfafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:22.334078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4c918-d7e5-4e08-921d-a67bdd1dfafe admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:22.334360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4c918-d7e5-4e08-921d-a67bdd1dfafe admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:22.334887 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4c918-d7e5-4e08-921d-a67bdd1dfafe admin admin] PATH_INFO: `/v3/users/c56a49935940457d8fb6fa79a556c97b` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:22.336066 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4c918-d7e5-4e08-921d-a67bdd1dfafe admin admin] RBAC: Authorizing `identity:get_user(user_id=c56a49935940457d8fb6fa79a556c97b)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:22.338272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4c918-d7e5-4e08-921d-a67bdd1dfafe admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:22.339808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 525/1054] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:22 2021] GET /identity/v3/users/c56a49935940457d8fb6fa79a556c97b => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:22.345792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89692a7-d0db-418e-bfb9-2204c3aaa73d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:22.355015 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89692a7-d0db-418e-bfb9-2204c3aaa73d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:22.360120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afbb96-1199-400c-9960-a2a74d07a317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:22.360742 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afbb96-1199-400c-9960-a2a74d07a317 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:22.361022 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afbb96-1199-400c-9960-a2a74d07a317 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:22.361293 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afbb96-1199-400c-9960-a2a74d07a317 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:22.368894 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afbb96-1199-400c-9960-a2a74d07a317 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:22.370636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afbb96-1199-400c-9960-a2a74d07a317 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:22.379635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 530/1055] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:19:22 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:19:22.385896 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4c918-d7e5-4e08-921d-a67bdd1dfafe admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:22.395168 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4c918-d7e5-4e08-921d-a67bdd1dfafe admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:22.399712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67912915-64f7-496f-8f2a-f4a7942ac54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:22.400521 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67912915-64f7-496f-8f2a-f4a7942ac54b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:22.400800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67912915-64f7-496f-8f2a-f4a7942ac54b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:22.401074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67912915-64f7-496f-8f2a-f4a7942ac54b admin admin] PATH_INFO: `/v3/projects/b96566913c3d4ce3b681e68bbcb26824` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:22.402241 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67912915-64f7-496f-8f2a-f4a7942ac54b admin admin] RBAC: Authorizing `identity:get_project(project_id=b96566913c3d4ce3b681e68bbcb26824)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:22.404206 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67912915-64f7-496f-8f2a-f4a7942ac54b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:22.405828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 526/1056] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:19:22 2021] GET /identity/v3/projects/b96566913c3d4ce3b681e68bbcb26824 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:19:22.412139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afbb96-1199-400c-9960-a2a74d07a317 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:22.420446 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afbb96-1199-400c-9960-a2a74d07a317 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:22.428344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8116a3-b02c-466d-8c68-572ef92c2633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:22.428965 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8116a3-b02c-466d-8c68-572ef92c2633 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:22.429246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8116a3-b02c-466d-8c68-572ef92c2633 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:22.429520 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8116a3-b02c-466d-8c68-572ef92c2633 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:22.430361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8116a3-b02c-466d-8c68-572ef92c2633 admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=b96566913c3d4ce3b681e68bbcb26824, user.id=c56a49935940457d8fb6fa79a556c97b) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:22.430671 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8116a3-b02c-466d-8c68-572ef92c2633 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:22.432492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8116a3-b02c-466d-8c68-572ef92c2633 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:22.438711 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 531/1057] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:19:22 2021] GET /identity/v3/role_assignments?user.id=c56a49935940457d8fb6fa79a556c97b&scope.project.id=b96566913c3d4ce3b681e68bbcb26824&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:24.584567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f8d8-4f78-4b20-b34d-e70ace383f4a None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:24.585115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f8d8-4f78-4b20-b34d-e70ace383f4a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:24.585115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f8d8-4f78-4b20-b34d-e70ace383f4a None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:24.586888 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 527/1058] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:24.592676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e019522-f939-402e-b68e-f789cdfdd710 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:24.593106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e019522-f939-402e-b68e-f789cdfdd710 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:24.593240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e019522-f939-402e-b68e-f789cdfdd710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:24.611346 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-4e019522-f939-402e-b68e-f789cdfdd710 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:24.612539 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4e019522-f939-402e-b68e-f789cdfdd710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:24.620067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 532/1059] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:19:24.644513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261f8d8-4f78-4b20-b34d-e70ace383f4a None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:24.658375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261f8d8-4f78-4b20-b34d-e70ace383f4a None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:24.662731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8f407-5cb3-4efc-b453-421b3a522255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:24.663347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8f407-5cb3-4efc-b453-421b3a522255 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:24.663620 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8f407-5cb3-4efc-b453-421b3a522255 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:24.663890 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8f407-5cb3-4efc-b453-421b3a522255 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:24.671515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8f407-5cb3-4efc-b453-421b3a522255 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:24.673289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8f407-5cb3-4efc-b453-421b3a522255 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:24.681773 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 528/1060] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:19:24 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:19:24.688629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e019522-f939-402e-b68e-f789cdfdd710 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:24.697406 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e019522-f939-402e-b68e-f789cdfdd710 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:24.702012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93272e2d-6f3b-4c62-82eb-9e2fe16118d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:24.703302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93272e2d-6f3b-4c62-82eb-9e2fe16118d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:24.703574 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93272e2d-6f3b-4c62-82eb-9e2fe16118d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:24.703840 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93272e2d-6f3b-4c62-82eb-9e2fe16118d9 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:24.710534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93272e2d-6f3b-4c62-82eb-9e2fe16118d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:24.712324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93272e2d-6f3b-4c62-82eb-9e2fe16118d9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:24.725941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-93272e2d-6f3b-4c62-82eb-9e2fe16118d9 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 14:19:24.727052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 533/1061] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Aug 29 14:19:24 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:19:24.733675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8f407-5cb3-4efc-b453-421b3a522255 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:24.742173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8f407-5cb3-4efc-b453-421b3a522255 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:24.746607 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32351c85-1ac5-4922-90c7-ac57afbb926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:24.747232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32351c85-1ac5-4922-90c7-ac57afbb926f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:24.747507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32351c85-1ac5-4922-90c7-ac57afbb926f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:24.747777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32351c85-1ac5-4922-90c7-ac57afbb926f admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:24.748467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32351c85-1ac5-4922-90c7-ac57afbb926f admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:24.748766 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32351c85-1ac5-4922-90c7-ac57afbb926f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:24.750357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32351c85-1ac5-4922-90c7-ac57afbb926f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:24.757450 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 529/1062] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Aug 29 14:19:24 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:19:26.882645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba147ce-4ede-40ba-bb24-560fcd4287d2 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:26.883171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba147ce-4ede-40ba-bb24-560fcd4287d2 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:26.883171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba147ce-4ede-40ba-bb24-560fcd4287d2 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:26.884947 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 534/1063] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:26.890828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0562fa-2f07-4926-9331-4b51f60d8999 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:26.891257 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0562fa-2f07-4926-9331-4b51f60d8999 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:26.891388 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0562fa-2f07-4926-9331-4b51f60d8999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:26.908597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-4b0562fa-2f07-4926-9331-4b51f60d8999 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:26.909786 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4b0562fa-2f07-4926-9331-4b51f60d8999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:26.917343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 530/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:19:26.942582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba147ce-4ede-40ba-bb24-560fcd4287d2 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:26.954878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba147ce-4ede-40ba-bb24-560fcd4287d2 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:26.958718 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb491798-f86c-4a6a-a18d-27c83f10e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:26.959358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb491798-f86c-4a6a-a18d-27c83f10e525 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:26.959633 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb491798-f86c-4a6a-a18d-27c83f10e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:26.959903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb491798-f86c-4a6a-a18d-27c83f10e525 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:26.960643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb491798-f86c-4a6a-a18d-27c83f10e525 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:26.961649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-bb491798-f86c-4a6a-a18d-27c83f10e525 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:19:26.961649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:19:26.961649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:19:26.962547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb491798-f86c-4a6a-a18d-27c83f10e525 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:27.105241 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 535/1065] 10.222.0.16 () {60 vars in 1160 bytes} [Sun Aug 29 14:19:26 2021] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:19:29.281124 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823a8f-87f2-472e-972e-2f2301d0354c None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:29.281627 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823a8f-87f2-472e-972e-2f2301d0354c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:29.281716 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823a8f-87f2-472e-972e-2f2301d0354c None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:29.283472 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 531/1066] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:29.289433 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401acf9d-a8d9-48f4-a5e5-dea4011fc158 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:29.289888 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401acf9d-a8d9-48f4-a5e5-dea4011fc158 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:29.290007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401acf9d-a8d9-48f4-a5e5-dea4011fc158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:29.307773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-401acf9d-a8d9-48f4-a5e5-dea4011fc158 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:29.308935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-401acf9d-a8d9-48f4-a5e5-dea4011fc158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:29.362936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 536/1067] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:19:29.388627 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3823a8f-87f2-472e-972e-2f2301d0354c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:29.400762 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3823a8f-87f2-472e-972e-2f2301d0354c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:29.405600 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d28b0-6cf2-4523-b331-7d1408a1c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:29.406607 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d28b0-6cf2-4523-b331-7d1408a1c078 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:29.406890 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d28b0-6cf2-4523-b331-7d1408a1c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:29.407161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d28b0-6cf2-4523-b331-7d1408a1c078 admin admin] PATH_INFO: `/v3/domains/5197ed203ba6405f85dc709ec4257e67` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:29.417329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d28b0-6cf2-4523-b331-7d1408a1c078 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=5197ed203ba6405f85dc709ec4257e67)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:29.419303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d28b0-6cf2-4523-b331-7d1408a1c078 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:29.421568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 532/1068] 10.222.0.16 () {56 vars in 1205 bytes} [Sun Aug 29 14:19:29 2021] GET /identity/v3/domains/5197ed203ba6405f85dc709ec4257e67 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:29.427818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401acf9d-a8d9-48f4-a5e5-dea4011fc158 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:29.436540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401acf9d-a8d9-48f4-a5e5-dea4011fc158 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:29.440978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0fb37-63f4-4017-a85b-0ffe23886902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:29.441616 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0fb37-63f4-4017-a85b-0ffe23886902 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:29.441921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0fb37-63f4-4017-a85b-0ffe23886902 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:29.442195 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0fb37-63f4-4017-a85b-0ffe23886902 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:29.442890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0fb37-63f4-4017-a85b-0ffe23886902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:29.444747 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0fb37-63f4-4017-a85b-0ffe23886902 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:29.573335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 537/1069] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:19:29 2021] POST /identity/v3/projects => generated 361 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:19:31.754441 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb368c-8a09-4990-bceb-bd3b94aa09b0 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:31.754962 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb368c-8a09-4990-bceb-bd3b94aa09b0 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:31.755052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb368c-8a09-4990-bceb-bd3b94aa09b0 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:31.756987 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 533/1070] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:31.762930 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b202fa-5fe2-47ea-9c86-5f2c90fda6ea None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:31.763345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b202fa-5fe2-47ea-9c86-5f2c90fda6ea None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:31.763482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b202fa-5fe2-47ea-9c86-5f2c90fda6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:31.780993 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-a7b202fa-5fe2-47ea-9c86-5f2c90fda6ea None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:31.782164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a7b202fa-5fe2-47ea-9c86-5f2c90fda6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:31.836972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 538/1071] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:19:31.864271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb368c-8a09-4990-bceb-bd3b94aa09b0 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:31.876127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb368c-8a09-4990-bceb-bd3b94aa09b0 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:31.880680 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2b1d0-a7c1-4993-ae2a-4b7ca23499c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:31.881511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b1d0-a7c1-4993-ae2a-4b7ca23499c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:31.881788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b1d0-a7c1-4993-ae2a-4b7ca23499c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:31.882089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b1d0-a7c1-4993-ae2a-4b7ca23499c0 admin admin] PATH_INFO: `/v3/domains/5197ed203ba6405f85dc709ec4257e67` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:31.883239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2b1d0-a7c1-4993-ae2a-4b7ca23499c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=5197ed203ba6405f85dc709ec4257e67)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:31.885160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2b1d0-a7c1-4993-ae2a-4b7ca23499c0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:31.886721 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 534/1072] 10.222.0.16 () {56 vars in 1205 bytes} [Sun Aug 29 14:19:31 2021] GET /identity/v3/domains/5197ed203ba6405f85dc709ec4257e67 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:31.892734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b202fa-5fe2-47ea-9c86-5f2c90fda6ea None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:31.901298 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b202fa-5fe2-47ea-9c86-5f2c90fda6ea None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:31.906233 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112dde6-681e-499c-95da-38136e0e51ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:31.906873 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112dde6-681e-499c-95da-38136e0e51ed admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:31.907148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112dde6-681e-499c-95da-38136e0e51ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:31.907416 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112dde6-681e-499c-95da-38136e0e51ed admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:31.908107 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112dde6-681e-499c-95da-38136e0e51ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:31.910021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112dde6-681e-499c-95da-38136e0e51ed admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:32.023914 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 539/1073] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:19:31 2021] POST /identity/v3/users => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:19:34.218138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6cc02-3937-4b27-a37a-992666bc3b26 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:34.218634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6cc02-3937-4b27-a37a-992666bc3b26 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:34.218634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6cc02-3937-4b27-a37a-992666bc3b26 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:34.220355 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 535/1074] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:34.226240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e667d7-7ff1-4c91-8abc-8fd184e208b1 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:34.226619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e667d7-7ff1-4c91-8abc-8fd184e208b1 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:34.226800 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e667d7-7ff1-4c91-8abc-8fd184e208b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:34.243946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-57e667d7-7ff1-4c91-8abc-8fd184e208b1 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:34.245129 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-57e667d7-7ff1-4c91-8abc-8fd184e208b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:34.253159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 540/1075] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:19:34.278325 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6cc02-3937-4b27-a37a-992666bc3b26 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:34.290163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6cc02-3937-4b27-a37a-992666bc3b26 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:34.294505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999764d-9436-4824-aa18-b3999406c780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:34.295777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999764d-9436-4824-aa18-b3999406c780 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:34.296060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999764d-9436-4824-aa18-b3999406c780 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:34.296333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999764d-9436-4824-aa18-b3999406c780 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:34.306387 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999764d-9436-4824-aa18-b3999406c780 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:19:34.313597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-5999764d-9436-4824-aa18-b3999406c780 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:19:34.314740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 536/1076] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:19:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:19:34.321264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e667d7-7ff1-4c91-8abc-8fd184e208b1 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:34.330086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e667d7-7ff1-4c91-8abc-8fd184e208b1 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:34.334431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7a64d-c461-47f6-a0d1-85fe93707735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:34.335073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7a64d-c461-47f6-a0d1-85fe93707735 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:34.335350 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7a64d-c461-47f6-a0d1-85fe93707735 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:34.335619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7a64d-c461-47f6-a0d1-85fe93707735 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:34.336343 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7a64d-c461-47f6-a0d1-85fe93707735 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:34.336643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7a64d-c461-47f6-a0d1-85fe93707735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:34.338247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7a64d-c461-47f6-a0d1-85fe93707735 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:34.346337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 541/1077] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:19:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:34.352454 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999764d-9436-4824-aa18-b3999406c780 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:34.362250 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999764d-9436-4824-aa18-b3999406c780 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:34.366768 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707ff65-e358-4c54-acda-6635f8b63b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:34.367620 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707ff65-e358-4c54-acda-6635f8b63b29 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:34.367872 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707ff65-e358-4c54-acda-6635f8b63b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:34.368141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707ff65-e358-4c54-acda-6635f8b63b29 admin admin] PATH_INFO: `/v3/users/6e5230c9e9174e9eb4a8f66c362efbb5` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:34.381988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707ff65-e358-4c54-acda-6635f8b63b29 admin admin] RBAC: Authorizing `identity:get_user(user_id=6e5230c9e9174e9eb4a8f66c362efbb5)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:34.384094 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707ff65-e358-4c54-acda-6635f8b63b29 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:34.385654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 537/1078] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:34 2021] GET /identity/v3/users/6e5230c9e9174e9eb4a8f66c362efbb5 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:34.391721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7a64d-c461-47f6-a0d1-85fe93707735 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:34.400949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7a64d-c461-47f6-a0d1-85fe93707735 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:34.405341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8fc1f-b813-4f17-ae30-a0b1dfd3e34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:34.405981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8fc1f-b813-4f17-ae30-a0b1dfd3e34e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:34.406263 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8fc1f-b813-4f17-ae30-a0b1dfd3e34e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:34.406536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8fc1f-b813-4f17-ae30-a0b1dfd3e34e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:34.413983 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8fc1f-b813-4f17-ae30-a0b1dfd3e34e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:34.415697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8fc1f-b813-4f17-ae30-a0b1dfd3e34e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:34.424971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 542/1079] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:19:34 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:19:34.430927 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707ff65-e358-4c54-acda-6635f8b63b29 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:34.440799 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707ff65-e358-4c54-acda-6635f8b63b29 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:34.445244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82944d18-5695-4bc1-851f-a813a04bd033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:34.446102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82944d18-5695-4bc1-851f-a813a04bd033 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:34.446382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82944d18-5695-4bc1-851f-a813a04bd033 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:34.446655 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82944d18-5695-4bc1-851f-a813a04bd033 admin admin] PATH_INFO: `/v3/projects/15b1360b3e054515826a5afbbea45320` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:34.447794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82944d18-5695-4bc1-851f-a813a04bd033 admin admin] RBAC: Authorizing `identity:get_project(project_id=15b1360b3e054515826a5afbbea45320)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:34.449772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82944d18-5695-4bc1-851f-a813a04bd033 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:34.451385 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 538/1080] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:19:34 2021] GET /identity/v3/projects/15b1360b3e054515826a5afbbea45320 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:34.457491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8fc1f-b813-4f17-ae30-a0b1dfd3e34e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:34.466008 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8fc1f-b813-4f17-ae30-a0b1dfd3e34e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:34.471052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a04db-e734-4edb-855f-ad3cff90815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:34.471625 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a04db-e734-4edb-855f-ad3cff90815b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:34.471908 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a04db-e734-4edb-855f-ad3cff90815b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:34.472185 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a04db-e734-4edb-855f-ad3cff90815b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:34.472992 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a04db-e734-4edb-855f-ad3cff90815b admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=15b1360b3e054515826a5afbbea45320, user.id=6e5230c9e9174e9eb4a8f66c362efbb5) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:34.473304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a04db-e734-4edb-855f-ad3cff90815b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:34.475136 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a04db-e734-4edb-855f-ad3cff90815b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:34.480377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 543/1081] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:19:34 2021] GET /identity/v3/role_assignments?user.id=6e5230c9e9174e9eb4a8f66c362efbb5&scope.project.id=15b1360b3e054515826a5afbbea45320&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:36.659564 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eab020-5f71-4d75-a0c2-fdfd42f34447 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:36.660113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eab020-5f71-4d75-a0c2-fdfd42f34447 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:36.660113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eab020-5f71-4d75-a0c2-fdfd42f34447 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:36.661845 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 539/1082] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:36.667733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8981c84-de96-4967-a6ae-8e49a26449a8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:36.668115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8981c84-de96-4967-a6ae-8e49a26449a8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:36.668285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8981c84-de96-4967-a6ae-8e49a26449a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:36.685458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c8981c84-de96-4967-a6ae-8e49a26449a8 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:36.687022 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c8981c84-de96-4967-a6ae-8e49a26449a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:36.694433 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 544/1083] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:19:36.719076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eab020-5f71-4d75-a0c2-fdfd42f34447 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:36.730953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eab020-5f71-4d75-a0c2-fdfd42f34447 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:36.735595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4553-dbf3-4ea9-bdd3-830f1ce39281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:36.736353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4553-dbf3-4ea9-bdd3-830f1ce39281 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:36.736631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4553-dbf3-4ea9-bdd3-830f1ce39281 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:36.736903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4553-dbf3-4ea9-bdd3-830f1ce39281 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:36.746579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d4553-dbf3-4ea9-bdd3-830f1ce39281 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:19:36.753478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-c56d4553-dbf3-4ea9-bdd3-830f1ce39281 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:19:36.754626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 540/1084] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:19:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:19:36.761595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8981c84-de96-4967-a6ae-8e49a26449a8 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:36.771040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8981c84-de96-4967-a6ae-8e49a26449a8 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:36.775501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0232e9c-9d86-436e-a301-9fcae98eeae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:36.776150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0232e9c-9d86-436e-a301-9fcae98eeae9 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:36.776428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0232e9c-9d86-436e-a301-9fcae98eeae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:36.776702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0232e9c-9d86-436e-a301-9fcae98eeae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:36.777435 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0232e9c-9d86-436e-a301-9fcae98eeae9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:36.777737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0232e9c-9d86-436e-a301-9fcae98eeae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:36.779360 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0232e9c-9d86-436e-a301-9fcae98eeae9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:36.788057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 545/1085] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:19:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:36.794063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4553-dbf3-4ea9-bdd3-830f1ce39281 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:36.804936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4553-dbf3-4ea9-bdd3-830f1ce39281 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:36.809425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4ab4-6fc4-4d63-aeff-e65cd7b9b82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:36.810284 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4ab4-6fc4-4d63-aeff-e65cd7b9b82d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:36.810568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4ab4-6fc4-4d63-aeff-e65cd7b9b82d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:36.811842 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4ab4-6fc4-4d63-aeff-e65cd7b9b82d admin admin] PATH_INFO: `/v3/users/6e5230c9e9174e9eb4a8f66c362efbb5` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:36.813021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a4ab4-6fc4-4d63-aeff-e65cd7b9b82d admin admin] RBAC: Authorizing `identity:get_user(user_id=6e5230c9e9174e9eb4a8f66c362efbb5)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:36.815224 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a4ab4-6fc4-4d63-aeff-e65cd7b9b82d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:36.816768 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 541/1086] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:36 2021] GET /identity/v3/users/6e5230c9e9174e9eb4a8f66c362efbb5 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:36.822798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0232e9c-9d86-436e-a301-9fcae98eeae9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:36.832027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0232e9c-9d86-436e-a301-9fcae98eeae9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:36.836435 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c7d99-4b2a-46c4-8f1a-07465850c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:36.837264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7d99-4b2a-46c4-8f1a-07465850c69d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:36.837544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7d99-4b2a-46c4-8f1a-07465850c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:36.837817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7d99-4b2a-46c4-8f1a-07465850c69d admin admin] PATH_INFO: `/v3/projects/15b1360b3e054515826a5afbbea45320` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:36.839009 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c7d99-4b2a-46c4-8f1a-07465850c69d admin admin] RBAC: Authorizing `identity:get_project(project_id=15b1360b3e054515826a5afbbea45320)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:36.841000 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c7d99-4b2a-46c4-8f1a-07465850c69d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:36.842642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 546/1087] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:19:36 2021] GET /identity/v3/projects/15b1360b3e054515826a5afbbea45320 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:36.849305 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4ab4-6fc4-4d63-aeff-e65cd7b9b82d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:36.860003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4ab4-6fc4-4d63-aeff-e65cd7b9b82d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:36.864499 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb600-0eb0-4669-90f2-1909773bec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:36.865335 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb600-0eb0-4669-90f2-1909773bec60 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:36.865612 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb600-0eb0-4669-90f2-1909773bec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:36.865908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb600-0eb0-4669-90f2-1909773bec60 admin admin] PATH_INFO: `/v3/projects/15b1360b3e054515826a5afbbea45320/users/6e5230c9e9174e9eb4a8f66c362efbb5/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:36.867867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cb600-0eb0-4669-90f2-1909773bec60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b1360b3e054515826a5afbbea45320, user_id=6e5230c9e9174e9eb4a8f66c362efbb5, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:36.870463 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cb600-0eb0-4669-90f2-1909773bec60 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:36.988700 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 542/1088] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:19:36 2021] PUT /identity/v3/projects/15b1360b3e054515826a5afbbea45320/users/6e5230c9e9174e9eb4a8f66c362efbb5/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:19:39.212583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2712-a568-4a6e-9e65-9ccbf9612ce3 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:39.213098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2712-a568-4a6e-9e65-9ccbf9612ce3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:39.213098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2712-a568-4a6e-9e65-9ccbf9612ce3 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:39.214866 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 547/1089] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:19:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:19:39.220722 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66e7b-70bc-4ef5-b53e-03e06643d298 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:39.221090 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66e7b-70bc-4ef5-b53e-03e06643d298 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:39.221272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66e7b-70bc-4ef5-b53e-03e06643d298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:39.238965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-5ed66e7b-70bc-4ef5-b53e-03e06643d298 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:19:39.240126 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5ed66e7b-70bc-4ef5-b53e-03e06643d298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:19:39.293683 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 543/1090] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:19:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:19:39.318081 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e2712-a568-4a6e-9e65-9ccbf9612ce3 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:39.330678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e2712-a568-4a6e-9e65-9ccbf9612ce3 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:39.335127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b169c4-226c-4666-84a0-59ad5946aa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:39.335902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b169c4-226c-4666-84a0-59ad5946aa22 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:39.336187 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b169c4-226c-4666-84a0-59ad5946aa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:39.336465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b169c4-226c-4666-84a0-59ad5946aa22 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:39.347303 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b169c4-226c-4666-84a0-59ad5946aa22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:19:39.354070 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-37b169c4-226c-4666-84a0-59ad5946aa22 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:19:39.355204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 548/1091] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:19:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:19:39.362090 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed66e7b-70bc-4ef5-b53e-03e06643d298 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:39.370587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed66e7b-70bc-4ef5-b53e-03e06643d298 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:39.375138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85544d48-d978-429f-b1d0-a7a02abba1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:39.375770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85544d48-d978-429f-b1d0-a7a02abba1ea admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:39.376045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85544d48-d978-429f-b1d0-a7a02abba1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:39.376313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85544d48-d978-429f-b1d0-a7a02abba1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:39.377040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85544d48-d978-429f-b1d0-a7a02abba1ea admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:39.377338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85544d48-d978-429f-b1d0-a7a02abba1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:39.378914 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85544d48-d978-429f-b1d0-a7a02abba1ea admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:39.386970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 544/1092] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:19:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:39.393579 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b169c4-226c-4666-84a0-59ad5946aa22 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:39.403537 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b169c4-226c-4666-84a0-59ad5946aa22 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:39.409097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305f387-5cca-4917-a2be-952482db2482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:39.409965 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305f387-5cca-4917-a2be-952482db2482 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:39.410251 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305f387-5cca-4917-a2be-952482db2482 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:39.410529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305f387-5cca-4917-a2be-952482db2482 admin admin] PATH_INFO: `/v3/users/6e5230c9e9174e9eb4a8f66c362efbb5` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:39.411726 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305f387-5cca-4917-a2be-952482db2482 admin admin] RBAC: Authorizing `identity:get_user(user_id=6e5230c9e9174e9eb4a8f66c362efbb5)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:39.413837 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305f387-5cca-4917-a2be-952482db2482 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:39.415423 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 549/1093] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:19:39 2021] GET /identity/v3/users/6e5230c9e9174e9eb4a8f66c362efbb5 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:39.421801 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85544d48-d978-429f-b1d0-a7a02abba1ea admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:39.430879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85544d48-d978-429f-b1d0-a7a02abba1ea admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:39.435310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c80af-efb5-48eb-a229-8e6409758836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:39.435986 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c80af-efb5-48eb-a229-8e6409758836 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:39.436260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c80af-efb5-48eb-a229-8e6409758836 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:39.436529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c80af-efb5-48eb-a229-8e6409758836 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:39.443902 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c80af-efb5-48eb-a229-8e6409758836 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:39.445592 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c80af-efb5-48eb-a229-8e6409758836 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:39.454277 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 545/1094] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:19:39 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:19:39.460263 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305f387-5cca-4917-a2be-952482db2482 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:39.470199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305f387-5cca-4917-a2be-952482db2482 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:39.474579 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0c1e1-9df4-4c73-9934-2271639ebdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:39.475395 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0c1e1-9df4-4c73-9934-2271639ebdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:39.475676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0c1e1-9df4-4c73-9934-2271639ebdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:39.475947 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0c1e1-9df4-4c73-9934-2271639ebdb7 admin admin] PATH_INFO: `/v3/projects/15b1360b3e054515826a5afbbea45320` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:39.477081 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0c1e1-9df4-4c73-9934-2271639ebdb7 admin admin] RBAC: Authorizing `identity:get_project(project_id=15b1360b3e054515826a5afbbea45320)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:39.479112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0c1e1-9df4-4c73-9934-2271639ebdb7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:39.480723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 550/1095] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:19:39 2021] GET /identity/v3/projects/15b1360b3e054515826a5afbbea45320 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:19:39.487766 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c80af-efb5-48eb-a229-8e6409758836 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:19:39.496030 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c80af-efb5-48eb-a229-8e6409758836 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:19:39.500869 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dae286-478c-4251-8da9-3b6f85d16146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:19:39.501482 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae286-478c-4251-8da9-3b6f85d16146 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:19:39.501758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae286-478c-4251-8da9-3b6f85d16146 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:19:39.502055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae286-478c-4251-8da9-3b6f85d16146 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:19:39.502853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dae286-478c-4251-8da9-3b6f85d16146 admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=15b1360b3e054515826a5afbbea45320, user.id=6e5230c9e9174e9eb4a8f66c362efbb5) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:19:39.503155 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dae286-478c-4251-8da9-3b6f85d16146 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:19:39.505180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dae286-478c-4251-8da9-3b6f85d16146 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:19:39.510601 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 546/1096] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:19:39 2021] GET /identity/v3/role_assignments?user.id=6e5230c9e9174e9eb4a8f66c362efbb5&scope.project.id=15b1360b3e054515826a5afbbea45320&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:20:55.773136 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975bb09-e3f0-44e2-b2db-be589bdd9ed4 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:55.773741 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975bb09-e3f0-44e2-b2db-be589bdd9ed4 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:55.773741 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975bb09-e3f0-44e2-b2db-be589bdd9ed4 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:55.775550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 551/1097] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:20:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:20:55.782146 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde1d61-32d2-4df6-973f-acae637ac453 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:55.782593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde1d61-32d2-4df6-973f-acae637ac453 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:55.782693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde1d61-32d2-4df6-973f-acae637ac453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:55.800165 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-afde1d61-32d2-4df6-973f-acae637ac453 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:20:55.809567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-afde1d61-32d2-4df6-973f-acae637ac453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:20:55.809567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 547/1098] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:20:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:20:55.834877 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975bb09-e3f0-44e2-b2db-be589bdd9ed4 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:55.847839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975bb09-e3f0-44e2-b2db-be589bdd9ed4 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:55.852143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7e71c-af44-4f2e-80d7-a5a0c2fffa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:55.853017 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e71c-af44-4f2e-80d7-a5a0c2fffa84 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:55.853296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e71c-af44-4f2e-80d7-a5a0c2fffa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:55.853570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7e71c-af44-4f2e-80d7-a5a0c2fffa84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:55.863826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7e71c-af44-4f2e-80d7-a5a0c2fffa84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:55.865641 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7e71c-af44-4f2e-80d7-a5a0c2fffa84 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:55.881719 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-adb7e71c-af44-4f2e-80d7-a5a0c2fffa84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:20:55.882861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 552/1099] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:20:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:20:55.889926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde1d61-32d2-4df6-973f-acae637ac453 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:55.898698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde1d61-32d2-4df6-973f-acae637ac453 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:55.903182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f325b1f-a352-409d-81fb-c902529aa21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:55.904488 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f325b1f-a352-409d-81fb-c902529aa21b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:55.904770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f325b1f-a352-409d-81fb-c902529aa21b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:55.905101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f325b1f-a352-409d-81fb-c902529aa21b admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:55.905742 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f325b1f-a352-409d-81fb-c902529aa21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:20:55.906073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f325b1f-a352-409d-81fb-c902529aa21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:55.907628 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f325b1f-a352-409d-81fb-c902529aa21b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:55.918430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 548/1100] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:20:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:20:55.924763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7e71c-af44-4f2e-80d7-a5a0c2fffa84 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:55.934803 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7e71c-af44-4f2e-80d7-a5a0c2fffa84 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:55.946938 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd3c59-1695-453b-b258-a9a5a92656d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:55.946938 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd3c59-1695-453b-b258-a9a5a92656d2 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:55.946938 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd3c59-1695-453b-b258-a9a5a92656d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:55.946938 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd3c59-1695-453b-b258-a9a5a92656d2 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:55.947387 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd3c59-1695-453b-b258-a9a5a92656d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:55.947387 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd3c59-1695-453b-b258-a9a5a92656d2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:56.048277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 553/1101] 10.222.0.16 () {60 vars in 1154 bytes} [Sun Aug 29 14:20:55 2021] POST /identity/v3/users => generated 251 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:20:58.241770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89987b4b-2dd0-43a7-b857-168edb0d6df9 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.242320 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89987b4b-2dd0-43a7-b857-168edb0d6df9 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.242320 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89987b4b-2dd0-43a7-b857-168edb0d6df9 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.244107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 549/1102] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:20:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:20:58.250091 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd429a8-9cf4-45a7-b633-377ecc8f57a1 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.250510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd429a8-9cf4-45a7-b633-377ecc8f57a1 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.250642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd429a8-9cf4-45a7-b633-377ecc8f57a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.268415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-fbd429a8-9cf4-45a7-b633-377ecc8f57a1 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:20:58.269661 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-fbd429a8-9cf4-45a7-b633-377ecc8f57a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:20:58.277378 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 554/1103] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:20:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:20:58.302935 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89987b4b-2dd0-43a7-b857-168edb0d6df9 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:58.315188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89987b4b-2dd0-43a7-b857-168edb0d6df9 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:58.319516 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f671c9-5174-4fa6-9323-e9dbc36ebdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:58.320280 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f671c9-5174-4fa6-9323-e9dbc36ebdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.320554 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f671c9-5174-4fa6-9323-e9dbc36ebdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.320865 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f671c9-5174-4fa6-9323-e9dbc36ebdb3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.331296 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f671c9-5174-4fa6-9323-e9dbc36ebdb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:20:58.338317 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-67f671c9-5174-4fa6-9323-e9dbc36ebdb3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:20:58.339452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 550/1104] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:20:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:20:58.346486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd429a8-9cf4-45a7-b633-377ecc8f57a1 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:58.355292 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd429a8-9cf4-45a7-b633-377ecc8f57a1 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:58.360379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db7ba6-8063-4655-8780-6f0d08474a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:58.361084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db7ba6-8063-4655-8780-6f0d08474a71 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.361360 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db7ba6-8063-4655-8780-6f0d08474a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.361628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db7ba6-8063-4655-8780-6f0d08474a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.362398 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db7ba6-8063-4655-8780-6f0d08474a71 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:20:58.362696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db7ba6-8063-4655-8780-6f0d08474a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:58.364279 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db7ba6-8063-4655-8780-6f0d08474a71 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:58.372346 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 555/1105] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:20:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:20:58.378852 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f671c9-5174-4fa6-9323-e9dbc36ebdb3 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:58.389130 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f671c9-5174-4fa6-9323-e9dbc36ebdb3 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:58.393919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859b6da-e8e0-488e-a526-38a451cbe607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:58.394689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859b6da-e8e0-488e-a526-38a451cbe607 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.394965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859b6da-e8e0-488e-a526-38a451cbe607 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.395237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859b6da-e8e0-488e-a526-38a451cbe607 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.406089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859b6da-e8e0-488e-a526-38a451cbe607 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:58.407876 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859b6da-e8e0-488e-a526-38a451cbe607 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:58.424886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-0859b6da-e8e0-488e-a526-38a451cbe607 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:20:58.427262 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 551/1106] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:20:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:20:58.432345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db7ba6-8063-4655-8780-6f0d08474a71 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:58.442040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db7ba6-8063-4655-8780-6f0d08474a71 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:58.446599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbee96-8753-4fee-bbf3-76ac2586242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:58.447205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbee96-8753-4fee-bbf3-76ac2586242f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.447482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbee96-8753-4fee-bbf3-76ac2586242f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.447752 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbee96-8753-4fee-bbf3-76ac2586242f admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.448455 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbee96-8753-4fee-bbf3-76ac2586242f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:20:58.448755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbee96-8753-4fee-bbf3-76ac2586242f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:58.450417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbee96-8753-4fee-bbf3-76ac2586242f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:58.462614 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 556/1107] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:20:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:20:58.469756 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859b6da-e8e0-488e-a526-38a451cbe607 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:58.479477 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859b6da-e8e0-488e-a526-38a451cbe607 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:58.485322 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d626d-e866-4a21-b93f-b76f42188740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:58.486137 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d626d-e866-4a21-b93f-b76f42188740 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.486419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d626d-e866-4a21-b93f-b76f42188740 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.486691 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d626d-e866-4a21-b93f-b76f42188740 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.496120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d626d-e866-4a21-b93f-b76f42188740 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:58.496120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d626d-e866-4a21-b93f-b76f42188740 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:58.510488 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-cd8d626d-e866-4a21-b93f-b76f42188740 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 14:20:58.511608 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 552/1108] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:20:58 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:20:58.518075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbee96-8753-4fee-bbf3-76ac2586242f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:58.527602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbee96-8753-4fee-bbf3-76ac2586242f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:58.532650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1469a87-e7c6-47b0-a12e-bb42a835b14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:58.533295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1469a87-e7c6-47b0-a12e-bb42a835b14d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.533573 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1469a87-e7c6-47b0-a12e-bb42a835b14d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.533843 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1469a87-e7c6-47b0-a12e-bb42a835b14d admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.534683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1469a87-e7c6-47b0-a12e-bb42a835b14d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:20:58.534988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1469a87-e7c6-47b0-a12e-bb42a835b14d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:58.536815 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1469a87-e7c6-47b0-a12e-bb42a835b14d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:58.554293 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 557/1109] 10.222.0.16 () {56 vars in 1165 bytes} [Sun Aug 29 14:20:58 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:20:58.560797 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d626d-e866-4a21-b93f-b76f42188740 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:58.570671 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d626d-e866-4a21-b93f-b76f42188740 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:58.575433 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579eebc-f5ed-445f-8872-f2b7143f163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:58.576534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579eebc-f5ed-445f-8872-f2b7143f163b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.576534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579eebc-f5ed-445f-8872-f2b7143f163b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.576821 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579eebc-f5ed-445f-8872-f2b7143f163b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.584572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579eebc-f5ed-445f-8872-f2b7143f163b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:58.586419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579eebc-f5ed-445f-8872-f2b7143f163b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:58.595862 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 553/1110] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:20:58 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:20:58.602129 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1469a87-e7c6-47b0-a12e-bb42a835b14d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:58.612222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1469a87-e7c6-47b0-a12e-bb42a835b14d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:58.616739 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c4c4c-352e-4a4a-a1e2-afcc394d98ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:58.617512 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c4c4c-352e-4a4a-a1e2-afcc394d98ba admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.617828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c4c4c-352e-4a4a-a1e2-afcc394d98ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.618337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c4c4c-352e-4a4a-a1e2-afcc394d98ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.628688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c4c4c-352e-4a4a-a1e2-afcc394d98ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:58.630575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c4c4c-352e-4a4a-a1e2-afcc394d98ba admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:58.647345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-415c4c4c-352e-4a4a-a1e2-afcc394d98ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:20:58.648461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 558/1111] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:20:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:20:58.655294 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579eebc-f5ed-445f-8872-f2b7143f163b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:58.663997 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579eebc-f5ed-445f-8872-f2b7143f163b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:58.668479 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b44f79-5b2a-45b7-9d8e-4fb5254a710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:58.669205 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b44f79-5b2a-45b7-9d8e-4fb5254a710b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.669499 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b44f79-5b2a-45b7-9d8e-4fb5254a710b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.669834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b44f79-5b2a-45b7-9d8e-4fb5254a710b admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.671121 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b44f79-5b2a-45b7-9d8e-4fb5254a710b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:20:58.672075 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b44f79-5b2a-45b7-9d8e-4fb5254a710b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:58.672981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b44f79-5b2a-45b7-9d8e-4fb5254a710b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:58.684190 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 554/1112] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:20:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:20:58.690674 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c4c4c-352e-4a4a-a1e2-afcc394d98ba admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:58.700132 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c4c4c-352e-4a4a-a1e2-afcc394d98ba admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:58.705339 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c2a84-5f8a-4a63-a788-4f1382df35bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:58.706133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c2a84-5f8a-4a63-a788-4f1382df35bf admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.706414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c2a84-5f8a-4a63-a788-4f1382df35bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.706687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c2a84-5f8a-4a63-a788-4f1382df35bf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.713334 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c2a84-5f8a-4a63-a788-4f1382df35bf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:58.715324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c2a84-5f8a-4a63-a788-4f1382df35bf admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:58.728546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-d35c2a84-5f8a-4a63-a788-4f1382df35bf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:20:58.729737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 559/1113] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:20:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:20:58.737181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b44f79-5b2a-45b7-9d8e-4fb5254a710b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:58.746674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b44f79-5b2a-45b7-9d8e-4fb5254a710b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:58.752531 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2087b-5e6b-4ac0-b65b-0567d4d23d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:58.753165 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2087b-5e6b-4ac0-b65b-0567d4d23d04 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.753444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2087b-5e6b-4ac0-b65b-0567d4d23d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.753716 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2087b-5e6b-4ac0-b65b-0567d4d23d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.754522 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2087b-5e6b-4ac0-b65b-0567d4d23d04 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:20:58.754828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2087b-5e6b-4ac0-b65b-0567d4d23d04 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:58.756644 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2087b-5e6b-4ac0-b65b-0567d4d23d04 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:58.768602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 555/1114] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:20:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:20:58.775331 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c2a84-5f8a-4a63-a788-4f1382df35bf admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:20:58.785427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c2a84-5f8a-4a63-a788-4f1382df35bf admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:20:58.789935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d9044-450c-4f02-8590-cc6225508721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:20:58.791062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d9044-450c-4f02-8590-cc6225508721 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:20:58.791062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d9044-450c-4f02-8590-cc6225508721 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:20:58.791062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d9044-450c-4f02-8590-cc6225508721 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:20:58.791870 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d9044-450c-4f02-8590-cc6225508721 admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=b77a408df11844e2aacbb366019dc3d9) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:20:58.792176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d9044-450c-4f02-8590-cc6225508721 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:20:58.794600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d9044-450c-4f02-8590-cc6225508721 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:20:58.799852 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 560/1115] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:20:58 2021] GET /identity/v3/role_assignments?user.id=b77a408df11844e2aacbb366019dc3d9&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:00.948503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7904e-7a53-4873-9ef5-2f8078758473 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:00.949057 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7904e-7a53-4873-9ef5-2f8078758473 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:00.949057 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7904e-7a53-4873-9ef5-2f8078758473 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:00.951078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 556/1116] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:21:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:21:00.957167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c466f0-af29-4b45-81ba-4e096afd8e96 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:00.957605 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c466f0-af29-4b45-81ba-4e096afd8e96 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:00.957704 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c466f0-af29-4b45-81ba-4e096afd8e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:00.974535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-f4c466f0-af29-4b45-81ba-4e096afd8e96 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:21:00.975707 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f4c466f0-af29-4b45-81ba-4e096afd8e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:21:00.983858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 561/1117] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:21:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:21:01.009112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7904e-7a53-4873-9ef5-2f8078758473 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:01.021160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7904e-7a53-4873-9ef5-2f8078758473 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:01.025545 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfb321-8877-458b-a2f4-6fe7ceb4e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:01.026356 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfb321-8877-458b-a2f4-6fe7ceb4e6db admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:01.026635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfb321-8877-458b-a2f4-6fe7ceb4e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:01.027682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfb321-8877-458b-a2f4-6fe7ceb4e6db admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:01.037197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfb321-8877-458b-a2f4-6fe7ceb4e6db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:21:01.044648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-5cbfb321-8877-458b-a2f4-6fe7ceb4e6db admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:21:01.045784 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 557/1118] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:21:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:01.052535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c466f0-af29-4b45-81ba-4e096afd8e96 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:01.062054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c466f0-af29-4b45-81ba-4e096afd8e96 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:01.066556 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941393e8-4f53-4e10-9a7b-36713e1a6ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:01.067211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941393e8-4f53-4e10-9a7b-36713e1a6ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:01.067492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941393e8-4f53-4e10-9a7b-36713e1a6ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:01.067763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941393e8-4f53-4e10-9a7b-36713e1a6ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:01.068497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941393e8-4f53-4e10-9a7b-36713e1a6ec7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:01.068798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941393e8-4f53-4e10-9a7b-36713e1a6ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:01.070411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941393e8-4f53-4e10-9a7b-36713e1a6ec7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:01.078198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 562/1119] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:21:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:01.084370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfb321-8877-458b-a2f4-6fe7ceb4e6db admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:01.095166 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfb321-8877-458b-a2f4-6fe7ceb4e6db admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:01.099704 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d765f46-a0e8-410d-8039-c4f7253715af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:01.100454 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765f46-a0e8-410d-8039-c4f7253715af admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:01.100731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765f46-a0e8-410d-8039-c4f7253715af admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:01.101000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765f46-a0e8-410d-8039-c4f7253715af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:01.111580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d765f46-a0e8-410d-8039-c4f7253715af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:01.113806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d765f46-a0e8-410d-8039-c4f7253715af admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:01.130661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-4d765f46-a0e8-410d-8039-c4f7253715af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:21:01.131777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 558/1120] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:01.138454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941393e8-4f53-4e10-9a7b-36713e1a6ec7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:01.148076 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941393e8-4f53-4e10-9a7b-36713e1a6ec7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:01.152750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dfb68-0df9-4235-892c-10cbbc164a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:01.153827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dfb68-0df9-4235-892c-10cbbc164a68 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:01.154098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dfb68-0df9-4235-892c-10cbbc164a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:01.154419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dfb68-0df9-4235-892c-10cbbc164a68 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:01.155205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dfb68-0df9-4235-892c-10cbbc164a68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:01.155508 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dfb68-0df9-4235-892c-10cbbc164a68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:01.157082 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dfb68-0df9-4235-892c-10cbbc164a68 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:01.168648 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 563/1121] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:21:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:01.175552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d765f46-a0e8-410d-8039-c4f7253715af admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:01.186212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d765f46-a0e8-410d-8039-c4f7253715af admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:01.190719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb72ee2-e862-4258-b14b-208c1f06e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:01.191490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb72ee2-e862-4258-b14b-208c1f06e529 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:01.191794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb72ee2-e862-4258-b14b-208c1f06e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:01.192066 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb72ee2-e862-4258-b14b-208c1f06e529 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:01.199194 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb72ee2-e862-4258-b14b-208c1f06e529 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:01.201368 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb72ee2-e862-4258-b14b-208c1f06e529 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:01.214895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-5fb72ee2-e862-4258-b14b-208c1f06e529 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 14:21:01.216567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 559/1122] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:01 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:01.223027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dfb68-0df9-4235-892c-10cbbc164a68 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:01.233261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dfb68-0df9-4235-892c-10cbbc164a68 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:01.237904 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cf644-6ae4-42bf-8635-722557dd1f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:01.238557 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cf644-6ae4-42bf-8635-722557dd1f32 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:01.238832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cf644-6ae4-42bf-8635-722557dd1f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:01.239098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cf644-6ae4-42bf-8635-722557dd1f32 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:01.239907 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cf644-6ae4-42bf-8635-722557dd1f32 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:01.240206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cf644-6ae4-42bf-8635-722557dd1f32 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:01.242054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cf644-6ae4-42bf-8635-722557dd1f32 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:01.258994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 564/1123] 10.222.0.16 () {56 vars in 1165 bytes} [Sun Aug 29 14:21:01 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:01.265225 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb72ee2-e862-4258-b14b-208c1f06e529 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:01.274754 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb72ee2-e862-4258-b14b-208c1f06e529 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:01.280061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de927-03e6-4ff1-8b68-6707c9601351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:01.280827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de927-03e6-4ff1-8b68-6707c9601351 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:01.281102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de927-03e6-4ff1-8b68-6707c9601351 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:01.281372 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de927-03e6-4ff1-8b68-6707c9601351 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:01.291269 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de927-03e6-4ff1-8b68-6707c9601351 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:01.293068 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de927-03e6-4ff1-8b68-6707c9601351 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:01.309904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-593de927-03e6-4ff1-8b68-6707c9601351 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:21:01.311019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 560/1124] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:01.317456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cf644-6ae4-42bf-8635-722557dd1f32 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:01.327149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cf644-6ae4-42bf-8635-722557dd1f32 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:01.331758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1d35-3103-4015-8314-166e3fafa4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:01.334329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1d35-3103-4015-8314-166e3fafa4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:01.334329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1d35-3103-4015-8314-166e3fafa4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:01.334329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1d35-3103-4015-8314-166e3fafa4b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:01.334329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b1d35-3103-4015-8314-166e3fafa4b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:01.334329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b1d35-3103-4015-8314-166e3fafa4b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:01.335781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b1d35-3103-4015-8314-166e3fafa4b2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:01.351100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 565/1125] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:21:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:21:01.358312 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de927-03e6-4ff1-8b68-6707c9601351 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:01.368097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de927-03e6-4ff1-8b68-6707c9601351 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:01.372760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b53a4d-a146-4ad1-b446-4400fc192f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:01.373598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b53a4d-a146-4ad1-b446-4400fc192f71 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:01.373900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b53a4d-a146-4ad1-b446-4400fc192f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:01.374181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b53a4d-a146-4ad1-b446-4400fc192f71 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:01.381307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b53a4d-a146-4ad1-b446-4400fc192f71 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:01.383276 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b53a4d-a146-4ad1-b446-4400fc192f71 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:01.396191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-80b53a4d-a146-4ad1-b446-4400fc192f71 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:21:01.397369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 561/1126] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:21:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:01.404500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1d35-3103-4015-8314-166e3fafa4b2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:01.414200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1d35-3103-4015-8314-166e3fafa4b2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:01.418750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe1400-0f18-4a1d-9835-3306ac13fe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:01.420025 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe1400-0f18-4a1d-9835-3306ac13fe8f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:01.420349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe1400-0f18-4a1d-9835-3306ac13fe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:01.420629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe1400-0f18-4a1d-9835-3306ac13fe8f admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:01.421408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe1400-0f18-4a1d-9835-3306ac13fe8f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:01.421713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe1400-0f18-4a1d-9835-3306ac13fe8f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:01.423654 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe1400-0f18-4a1d-9835-3306ac13fe8f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:01.435612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 566/1127] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:21:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:21:01.442086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b53a4d-a146-4ad1-b446-4400fc192f71 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:01.452302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b53a4d-a146-4ad1-b446-4400fc192f71 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:01.456706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a55dd7-7822-4731-b737-e372b45b1f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:01.457579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a55dd7-7822-4731-b737-e372b45b1f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:01.457857 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a55dd7-7822-4731-b737-e372b45b1f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:01.458230 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a55dd7-7822-4731-b737-e372b45b1f26 admin admin] PATH_INFO: `/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/b77a408df11844e2aacbb366019dc3d9/roles/ac37a5f3e1454b8f929c2419c3e148cb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:01.472271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a55dd7-7822-4731-b737-e372b45b1f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c728e9160de45afbd4902c27eef45b3, user_id=b77a408df11844e2aacbb366019dc3d9, role_id=ac37a5f3e1454b8f929c2419c3e148cb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:01.474943 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a55dd7-7822-4731-b737-e372b45b1f26 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:01.574003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 562/1128] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:21:01 2021] PUT /identity/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/b77a408df11844e2aacbb366019dc3d9/roles/ac37a5f3e1454b8f929c2419c3e148cb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:21:03.712438 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283388df-1d97-48ae-992d-4c437cd501f3 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:03.712998 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283388df-1d97-48ae-992d-4c437cd501f3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:03.712998 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283388df-1d97-48ae-992d-4c437cd501f3 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:03.714802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 567/1129] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:21:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:21:03.721301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddacfb1-8591-4e9d-8c4f-d22b279db5ed None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:03.721732 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddacfb1-8591-4e9d-8c4f-d22b279db5ed None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:03.721848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddacfb1-8591-4e9d-8c4f-d22b279db5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:03.740636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-fddacfb1-8591-4e9d-8c4f-d22b279db5ed None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:21:03.741815 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-fddacfb1-8591-4e9d-8c4f-d22b279db5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:21:03.796371 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 563/1130] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:21:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:21:03.822423 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283388df-1d97-48ae-992d-4c437cd501f3 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:03.835306 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283388df-1d97-48ae-992d-4c437cd501f3 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:03.839986 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115629f1-db79-4370-b752-abc648a9e7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:03.840850 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115629f1-db79-4370-b752-abc648a9e7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:03.841126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115629f1-db79-4370-b752-abc648a9e7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:03.841400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115629f1-db79-4370-b752-abc648a9e7c4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:03.851571 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115629f1-db79-4370-b752-abc648a9e7c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:21:03.859203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-115629f1-db79-4370-b752-abc648a9e7c4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 14:21:03.860442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 568/1131] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Aug 29 14:21:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:03.866970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddacfb1-8591-4e9d-8c4f-d22b279db5ed None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:03.876261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddacfb1-8591-4e9d-8c4f-d22b279db5ed None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:03.881087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6552445-45cd-452d-ad16-014d9cf31114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:03.881731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6552445-45cd-452d-ad16-014d9cf31114 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:03.882040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6552445-45cd-452d-ad16-014d9cf31114 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:03.882313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6552445-45cd-452d-ad16-014d9cf31114 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:03.883046 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6552445-45cd-452d-ad16-014d9cf31114 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:03.883423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6552445-45cd-452d-ad16-014d9cf31114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:03.884978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6552445-45cd-452d-ad16-014d9cf31114 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:03.892903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 564/1132] 10.222.0.16 () {56 vars in 1125 bytes} [Sun Aug 29 14:21:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:03.899011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115629f1-db79-4370-b752-abc648a9e7c4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:03.909247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115629f1-db79-4370-b752-abc648a9e7c4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:03.913846 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b327f-4c78-4742-a586-387fe8c2d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:03.914622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b327f-4c78-4742-a586-387fe8c2d693 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:03.914902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b327f-4c78-4742-a586-387fe8c2d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:03.915172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b327f-4c78-4742-a586-387fe8c2d693 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:03.925606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b327f-4c78-4742-a586-387fe8c2d693 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:03.927584 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b327f-4c78-4742-a586-387fe8c2d693 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:03.944567 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-da3b327f-4c78-4742-a586-387fe8c2d693 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:21:03.945729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 569/1133] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:03.952509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6552445-45cd-452d-ad16-014d9cf31114 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:03.962372 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6552445-45cd-452d-ad16-014d9cf31114 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:03.969272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54172b62-f5a1-4d8f-bda6-d36849326124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:03.969272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54172b62-f5a1-4d8f-bda6-d36849326124 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:03.969272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54172b62-f5a1-4d8f-bda6-d36849326124 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:03.969272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54172b62-f5a1-4d8f-bda6-d36849326124 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:03.969658 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54172b62-f5a1-4d8f-bda6-d36849326124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:03.969658 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54172b62-f5a1-4d8f-bda6-d36849326124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:03.970771 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54172b62-f5a1-4d8f-bda6-d36849326124 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:03.983061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 565/1134] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:21:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:03.989297 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b327f-4c78-4742-a586-387fe8c2d693 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:03.999809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b327f-4c78-4742-a586-387fe8c2d693 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:04.004604 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57f834-470b-448d-859e-dc04d37fe7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:04.005381 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57f834-470b-448d-859e-dc04d37fe7fd admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:04.005662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57f834-470b-448d-859e-dc04d37fe7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:04.005967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57f834-470b-448d-859e-dc04d37fe7fd admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:04.013090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57f834-470b-448d-859e-dc04d37fe7fd admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:04.015291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57f834-470b-448d-859e-dc04d37fe7fd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:04.029106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-cc57f834-470b-448d-859e-dc04d37fe7fd admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 14:21:04.030285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 570/1135] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:03 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:04.036492 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54172b62-f5a1-4d8f-bda6-d36849326124 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:04.046511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54172b62-f5a1-4d8f-bda6-d36849326124 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:04.050990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec3dd2-07e7-4293-81e4-dbc7e8ec56c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:04.051676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec3dd2-07e7-4293-81e4-dbc7e8ec56c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:04.051954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec3dd2-07e7-4293-81e4-dbc7e8ec56c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:04.052260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec3dd2-07e7-4293-81e4-dbc7e8ec56c0 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:04.053082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec3dd2-07e7-4293-81e4-dbc7e8ec56c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:04.053388 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec3dd2-07e7-4293-81e4-dbc7e8ec56c0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:04.055269 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec3dd2-07e7-4293-81e4-dbc7e8ec56c0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:04.072654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 566/1136] 10.222.0.16 () {56 vars in 1165 bytes} [Sun Aug 29 14:21:04 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:04.079006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57f834-470b-448d-859e-dc04d37fe7fd admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:04.088436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57f834-470b-448d-859e-dc04d37fe7fd admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:04.093090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9a594-3fbc-4e2f-9050-4998cd315d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:04.093710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9a594-3fbc-4e2f-9050-4998cd315d98 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:04.094032 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9a594-3fbc-4e2f-9050-4998cd315d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:04.094348 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9a594-3fbc-4e2f-9050-4998cd315d98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:04.101785 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9a594-3fbc-4e2f-9050-4998cd315d98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:04.103542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9a594-3fbc-4e2f-9050-4998cd315d98 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:04.112966 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 571/1137] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:21:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:21:04.119189 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec3dd2-07e7-4293-81e4-dbc7e8ec56c0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:04.133421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec3dd2-07e7-4293-81e4-dbc7e8ec56c0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:04.138324 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94f56c-b072-4c44-904f-20e29af0145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:04.139105 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94f56c-b072-4c44-904f-20e29af0145d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:04.139385 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94f56c-b072-4c44-904f-20e29af0145d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:04.139659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94f56c-b072-4c44-904f-20e29af0145d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:04.149510 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94f56c-b072-4c44-904f-20e29af0145d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:04.151347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94f56c-b072-4c44-904f-20e29af0145d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:04.167812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-dc94f56c-b072-4c44-904f-20e29af0145d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:21:04.169498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 567/1138] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:04.176002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9a594-3fbc-4e2f-9050-4998cd315d98 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:04.185401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9a594-3fbc-4e2f-9050-4998cd315d98 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:04.190007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7b924-694d-43ac-a329-d64ab41c9f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:04.190778 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7b924-694d-43ac-a329-d64ab41c9f23 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:04.191057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7b924-694d-43ac-a329-d64ab41c9f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:04.191329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7b924-694d-43ac-a329-d64ab41c9f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:04.192034 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7b924-694d-43ac-a329-d64ab41c9f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:04.192335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7b924-694d-43ac-a329-d64ab41c9f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:04.193921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7b924-694d-43ac-a329-d64ab41c9f23 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:04.204911 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 572/1139] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:21:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:04.210909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94f56c-b072-4c44-904f-20e29af0145d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:04.224385 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94f56c-b072-4c44-904f-20e29af0145d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:04.228632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efed300-da55-496e-8898-4ff882ad0aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:04.229437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efed300-da55-496e-8898-4ff882ad0aef admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:04.229686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efed300-da55-496e-8898-4ff882ad0aef admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:04.229993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efed300-da55-496e-8898-4ff882ad0aef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:04.237739 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efed300-da55-496e-8898-4ff882ad0aef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:04.239701 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efed300-da55-496e-8898-4ff882ad0aef admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:04.253125 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-2efed300-da55-496e-8898-4ff882ad0aef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:21:04.254302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 568/1140] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:21:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:04.260633 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7b924-694d-43ac-a329-d64ab41c9f23 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:04.270094 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7b924-694d-43ac-a329-d64ab41c9f23 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:04.274675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3ce4a-0b9b-4120-8f64-8fdd85af7b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:04.275433 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3ce4a-0b9b-4120-8f64-8fdd85af7b13 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:04.275688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3ce4a-0b9b-4120-8f64-8fdd85af7b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:04.275960 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3ce4a-0b9b-4120-8f64-8fdd85af7b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:04.276729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3ce4a-0b9b-4120-8f64-8fdd85af7b13 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:04.277032 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3ce4a-0b9b-4120-8f64-8fdd85af7b13 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:04.279877 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3ce4a-0b9b-4120-8f64-8fdd85af7b13 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:04.291728 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 573/1141] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:21:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:04.299013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efed300-da55-496e-8898-4ff882ad0aef admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:04.309165 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efed300-da55-496e-8898-4ff882ad0aef admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:04.314054 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f536094-4db8-499c-8e97-484995e4e26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:04.314672 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f536094-4db8-499c-8e97-484995e4e26b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:04.314951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f536094-4db8-499c-8e97-484995e4e26b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:04.315219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f536094-4db8-499c-8e97-484995e4e26b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:04.316024 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f536094-4db8-499c-8e97-484995e4e26b admin admin] RBAC: Adding query filter params (role.id=ac37a5f3e1454b8f929c2419c3e148cb, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=b77a408df11844e2aacbb366019dc3d9) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:04.316330 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f536094-4db8-499c-8e97-484995e4e26b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:04.318163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f536094-4db8-499c-8e97-484995e4e26b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:04.324924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 569/1142] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:21:04 2021] GET /identity/v3/role_assignments?user.id=b77a408df11844e2aacbb366019dc3d9&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=ac37a5f3e1454b8f929c2419c3e148cb => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:06.522489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa0e7-7d36-44b4-8122-1bc3d8c99d77 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:06.523019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa0e7-7d36-44b4-8122-1bc3d8c99d77 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:06.523132 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa0e7-7d36-44b4-8122-1bc3d8c99d77 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:06.524829 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 574/1143] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:21:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:21:06.531359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77281614-d230-44ed-9961-b5a4238df6c0 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:06.531778 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77281614-d230-44ed-9961-b5a4238df6c0 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:06.531946 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77281614-d230-44ed-9961-b5a4238df6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:06.550202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-77281614-d230-44ed-9961-b5a4238df6c0 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:21:06.551727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-77281614-d230-44ed-9961-b5a4238df6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:21:06.559006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 570/1144] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:21:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:21:06.583257 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aa0e7-7d36-44b4-8122-1bc3d8c99d77 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:06.595635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aa0e7-7d36-44b4-8122-1bc3d8c99d77 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:06.599918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea26155-b4eb-49e4-858a-7559e73d73aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:06.600682 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea26155-b4eb-49e4-858a-7559e73d73aa admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:06.600959 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea26155-b4eb-49e4-858a-7559e73d73aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:06.601226 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea26155-b4eb-49e4-858a-7559e73d73aa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:06.611799 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea26155-b4eb-49e4-858a-7559e73d73aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:21:06.618563 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-7ea26155-b4eb-49e4-858a-7559e73d73aa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:21:06.620994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 575/1145] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:21:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:06.626073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77281614-d230-44ed-9961-b5a4238df6c0 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:06.635215 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77281614-d230-44ed-9961-b5a4238df6c0 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:06.639910 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b036e-0f38-4a97-9fb7-9b12c79fd332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:06.640563 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b036e-0f38-4a97-9fb7-9b12c79fd332 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:06.640842 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b036e-0f38-4a97-9fb7-9b12c79fd332 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:06.641111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b036e-0f38-4a97-9fb7-9b12c79fd332 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:06.641916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b036e-0f38-4a97-9fb7-9b12c79fd332 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:06.647779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b036e-0f38-4a97-9fb7-9b12c79fd332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:06.647779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b036e-0f38-4a97-9fb7-9b12c79fd332 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:06.651879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 571/1146] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:21:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:21:06.658677 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea26155-b4eb-49e4-858a-7559e73d73aa admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:06.668855 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea26155-b4eb-49e4-858a-7559e73d73aa admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:06.674010 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e0222-bdbc-4706-9a30-2565bbcd307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:06.674770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e0222-bdbc-4706-9a30-2565bbcd307b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:06.676502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e0222-bdbc-4706-9a30-2565bbcd307b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:06.676502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e0222-bdbc-4706-9a30-2565bbcd307b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:06.685204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e0222-bdbc-4706-9a30-2565bbcd307b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:06.686972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e0222-bdbc-4706-9a30-2565bbcd307b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:06.704014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-719e0222-bdbc-4706-9a30-2565bbcd307b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:21:06.705320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 576/1147] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:06.711680 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b036e-0f38-4a97-9fb7-9b12c79fd332 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:06.722102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b036e-0f38-4a97-9fb7-9b12c79fd332 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:06.726771 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb85b16-1280-4875-bcac-103080d30970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:06.727618 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb85b16-1280-4875-bcac-103080d30970 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:06.727909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb85b16-1280-4875-bcac-103080d30970 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:06.728186 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb85b16-1280-4875-bcac-103080d30970 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:06.728892 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb85b16-1280-4875-bcac-103080d30970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:06.729240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb85b16-1280-4875-bcac-103080d30970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:06.730834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb85b16-1280-4875-bcac-103080d30970 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:06.745427 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 572/1148] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:21:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:06.749818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e0222-bdbc-4706-9a30-2565bbcd307b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:06.759645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e0222-bdbc-4706-9a30-2565bbcd307b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:06.764858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabea91-ed73-49dd-8e4b-07b6f935c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:06.767109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabea91-ed73-49dd-8e4b-07b6f935c7ba admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:06.767109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabea91-ed73-49dd-8e4b-07b6f935c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:06.767109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabea91-ed73-49dd-8e4b-07b6f935c7ba admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:06.773285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabea91-ed73-49dd-8e4b-07b6f935c7ba admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:06.775264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabea91-ed73-49dd-8e4b-07b6f935c7ba admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:06.789782 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-3dabea91-ed73-49dd-8e4b-07b6f935c7ba admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 14:21:06.790920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 577/1149] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:06 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:06.797963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb85b16-1280-4875-bcac-103080d30970 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:06.807650 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb85b16-1280-4875-bcac-103080d30970 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:06.812752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440e850-5525-4c58-b805-2c2630705069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:06.813512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440e850-5525-4c58-b805-2c2630705069 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:06.813789 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440e850-5525-4c58-b805-2c2630705069 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:06.814079 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440e850-5525-4c58-b805-2c2630705069 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:06.814896 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440e850-5525-4c58-b805-2c2630705069 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:06.815196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440e850-5525-4c58-b805-2c2630705069 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:06.816994 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440e850-5525-4c58-b805-2c2630705069 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:06.833990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 573/1150] 10.222.0.16 () {56 vars in 1165 bytes} [Sun Aug 29 14:21:06 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:06.840387 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabea91-ed73-49dd-8e4b-07b6f935c7ba admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:06.850587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabea91-ed73-49dd-8e4b-07b6f935c7ba admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:06.855441 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb916ab-1e3b-47c0-aa7e-ca6fb0155f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:06.856071 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb916ab-1e3b-47c0-aa7e-ca6fb0155f1e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:06.856350 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb916ab-1e3b-47c0-aa7e-ca6fb0155f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:06.856673 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb916ab-1e3b-47c0-aa7e-ca6fb0155f1e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:06.864958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb916ab-1e3b-47c0-aa7e-ca6fb0155f1e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:06.866729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb916ab-1e3b-47c0-aa7e-ca6fb0155f1e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:06.875735 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 578/1151] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:21:06 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:21:06.882542 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440e850-5525-4c58-b805-2c2630705069 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:06.892907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440e850-5525-4c58-b805-2c2630705069 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:06.897383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de993074-2928-4fb9-8aa9-791143ea534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:06.898183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de993074-2928-4fb9-8aa9-791143ea534c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:06.898462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de993074-2928-4fb9-8aa9-791143ea534c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:06.898734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de993074-2928-4fb9-8aa9-791143ea534c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:06.909316 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de993074-2928-4fb9-8aa9-791143ea534c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:06.911128 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de993074-2928-4fb9-8aa9-791143ea534c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:06.927410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-de993074-2928-4fb9-8aa9-791143ea534c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:21:06.928556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 574/1152] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:06.935211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb916ab-1e3b-47c0-aa7e-ca6fb0155f1e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:06.943936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb916ab-1e3b-47c0-aa7e-ca6fb0155f1e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:06.948534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4b5d5-c237-4494-b849-06f82b008f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:06.949169 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4b5d5-c237-4494-b849-06f82b008f1b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:06.949448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4b5d5-c237-4494-b849-06f82b008f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:06.949721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4b5d5-c237-4494-b849-06f82b008f1b admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:06.951105 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4b5d5-c237-4494-b849-06f82b008f1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:06.951601 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4b5d5-c237-4494-b849-06f82b008f1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:06.953175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4b5d5-c237-4494-b849-06f82b008f1b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:06.964698 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 579/1153] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:21:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:06.971591 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de993074-2928-4fb9-8aa9-791143ea534c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:06.981178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de993074-2928-4fb9-8aa9-791143ea534c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:06.985887 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b324fb-cbb5-4960-a60a-7b1ce6fa214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:06.986661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b324fb-cbb5-4960-a60a-7b1ce6fa214d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:06.986936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b324fb-cbb5-4960-a60a-7b1ce6fa214d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:06.987203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b324fb-cbb5-4960-a60a-7b1ce6fa214d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:06.993921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b324fb-cbb5-4960-a60a-7b1ce6fa214d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:06.995828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b324fb-cbb5-4960-a60a-7b1ce6fa214d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:07.008855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-a7b324fb-cbb5-4960-a60a-7b1ce6fa214d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:21:07.010018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 575/1154] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:21:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:07.016693 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4b5d5-c237-4494-b849-06f82b008f1b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:07.029761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4b5d5-c237-4494-b849-06f82b008f1b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:07.031539 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f40a0-3338-46a5-9f60-5f22d6f68e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:07.032180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f40a0-3338-46a5-9f60-5f22d6f68e1e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:07.032465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f40a0-3338-46a5-9f60-5f22d6f68e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:07.032742 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f40a0-3338-46a5-9f60-5f22d6f68e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:07.033517 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f40a0-3338-46a5-9f60-5f22d6f68e1e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:07.033823 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f40a0-3338-46a5-9f60-5f22d6f68e1e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:07.035675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f40a0-3338-46a5-9f60-5f22d6f68e1e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:07.047513 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 580/1155] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:21:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:21:07.054095 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b324fb-cbb5-4960-a60a-7b1ce6fa214d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:07.064779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b324fb-cbb5-4960-a60a-7b1ce6fa214d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:07.069404 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff89e6-5f3a-44a0-97d3-596b6b02bff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:07.070076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff89e6-5f3a-44a0-97d3-596b6b02bff0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:07.070357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff89e6-5f3a-44a0-97d3-596b6b02bff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:07.070630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff89e6-5f3a-44a0-97d3-596b6b02bff0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:07.071444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff89e6-5f3a-44a0-97d3-596b6b02bff0 admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=b77a408df11844e2aacbb366019dc3d9) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:07.071752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff89e6-5f3a-44a0-97d3-596b6b02bff0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:07.073619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff89e6-5f3a-44a0-97d3-596b6b02bff0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:07.079681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 576/1156] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:21:07 2021] GET /identity/v3/role_assignments?user.id=b77a408df11844e2aacbb366019dc3d9&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:09.259003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822834c9-b47f-414f-9da3-da0a2fe69030 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.259516 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822834c9-b47f-414f-9da3-da0a2fe69030 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.259516 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822834c9-b47f-414f-9da3-da0a2fe69030 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.261552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 581/1157] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:21:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:21:09.267973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fde25-cd66-4750-9b86-f574e2b5d871 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.268379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fde25-cd66-4750-9b86-f574e2b5d871 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.268552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fde25-cd66-4750-9b86-f574e2b5d871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.286374 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-ab2fde25-cd66-4750-9b86-f574e2b5d871 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:21:09.287547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ab2fde25-cd66-4750-9b86-f574e2b5d871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:21:09.295187 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 577/1158] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:21:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:21:09.318987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822834c9-b47f-414f-9da3-da0a2fe69030 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:09.331512 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822834c9-b47f-414f-9da3-da0a2fe69030 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:09.335906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b454c4d-38ec-4cd1-93b7-d1ed82962503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:09.336679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454c4d-38ec-4cd1-93b7-d1ed82962503 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.336956 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454c4d-38ec-4cd1-93b7-d1ed82962503 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.337226 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b454c4d-38ec-4cd1-93b7-d1ed82962503 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.347894 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b454c4d-38ec-4cd1-93b7-d1ed82962503 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:21:09.354631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-4b454c4d-38ec-4cd1-93b7-d1ed82962503 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:21:09.355779 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 582/1159] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:21:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:09.362245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fde25-cd66-4750-9b86-f574e2b5d871 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:09.370998 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fde25-cd66-4750-9b86-f574e2b5d871 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:09.375896 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16491e25-0a77-4955-b32f-412250e032be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:09.376539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16491e25-0a77-4955-b32f-412250e032be admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.376817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16491e25-0a77-4955-b32f-412250e032be admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.377088 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16491e25-0a77-4955-b32f-412250e032be admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.378167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16491e25-0a77-4955-b32f-412250e032be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:09.378453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16491e25-0a77-4955-b32f-412250e032be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:09.380057 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16491e25-0a77-4955-b32f-412250e032be admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:09.388820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 578/1160] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:21:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:09.395663 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b454c4d-38ec-4cd1-93b7-d1ed82962503 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:09.405847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b454c4d-38ec-4cd1-93b7-d1ed82962503 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:09.410876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b20e71-d640-4df7-aded-9be0e4b21d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:09.411655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20e71-d640-4df7-aded-9be0e4b21d68 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.411936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20e71-d640-4df7-aded-9be0e4b21d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.412208 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20e71-d640-4df7-aded-9be0e4b21d68 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.422752 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b20e71-d640-4df7-aded-9be0e4b21d68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:09.424576 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b20e71-d640-4df7-aded-9be0e4b21d68 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:09.440143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-a7b20e71-d640-4df7-aded-9be0e4b21d68 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:21:09.441318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 583/1161] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:09.447884 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16491e25-0a77-4955-b32f-412250e032be admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:09.457997 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16491e25-0a77-4955-b32f-412250e032be admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:09.462554 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83984359-9149-46ec-99a1-984d87aa7ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:09.463192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83984359-9149-46ec-99a1-984d87aa7ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.463468 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83984359-9149-46ec-99a1-984d87aa7ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.463736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83984359-9149-46ec-99a1-984d87aa7ac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.468127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83984359-9149-46ec-99a1-984d87aa7ac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:09.468127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83984359-9149-46ec-99a1-984d87aa7ac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:09.468127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83984359-9149-46ec-99a1-984d87aa7ac6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:09.481176 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 579/1162] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:21:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:09.488028 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b20e71-d640-4df7-aded-9be0e4b21d68 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:09.498727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b20e71-d640-4df7-aded-9be0e4b21d68 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:09.503624 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a507b48-9fec-40d8-bcd6-41b84c42eff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:09.504410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a507b48-9fec-40d8-bcd6-41b84c42eff3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.508500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a507b48-9fec-40d8-bcd6-41b84c42eff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.508500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a507b48-9fec-40d8-bcd6-41b84c42eff3 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.512877 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a507b48-9fec-40d8-bcd6-41b84c42eff3 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:09.515511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a507b48-9fec-40d8-bcd6-41b84c42eff3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:09.528837 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-1a507b48-9fec-40d8-bcd6-41b84c42eff3 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 14:21:09.530151 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 584/1163] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:09 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:21:09.537249 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83984359-9149-46ec-99a1-984d87aa7ac6 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:09.548012 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83984359-9149-46ec-99a1-984d87aa7ac6 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:09.552803 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ffee0-eae7-40a9-9acc-e88d172257e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:09.553451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ffee0-eae7-40a9-9acc-e88d172257e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.553731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ffee0-eae7-40a9-9acc-e88d172257e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.554040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ffee0-eae7-40a9-9acc-e88d172257e6 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.554851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ffee0-eae7-40a9-9acc-e88d172257e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:09.555150 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ffee0-eae7-40a9-9acc-e88d172257e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:09.556967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ffee0-eae7-40a9-9acc-e88d172257e6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:09.574293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 580/1164] 10.222.0.16 () {56 vars in 1165 bytes} [Sun Aug 29 14:21:09 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:09.581168 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a507b48-9fec-40d8-bcd6-41b84c42eff3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:09.590763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a507b48-9fec-40d8-bcd6-41b84c42eff3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:09.595512 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdce688-d8d3-48fe-8b3c-232173544f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:09.596284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdce688-d8d3-48fe-8b3c-232173544f0c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.596564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdce688-d8d3-48fe-8b3c-232173544f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.596838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdce688-d8d3-48fe-8b3c-232173544f0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.607582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdce688-d8d3-48fe-8b3c-232173544f0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:09.609404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdce688-d8d3-48fe-8b3c-232173544f0c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:09.626121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-dbdce688-d8d3-48fe-8b3c-232173544f0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:21:09.627372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 585/1165] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:21:09.634111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ffee0-eae7-40a9-9acc-e88d172257e6 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:09.644676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ffee0-eae7-40a9-9acc-e88d172257e6 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:09.649428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc814f5-02d8-447d-9e59-3d66f4537fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:09.650117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc814f5-02d8-447d-9e59-3d66f4537fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.650396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc814f5-02d8-447d-9e59-3d66f4537fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.650670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc814f5-02d8-447d-9e59-3d66f4537fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.657565 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc814f5-02d8-447d-9e59-3d66f4537fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:09.657565 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc814f5-02d8-447d-9e59-3d66f4537fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:09.657565 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc814f5-02d8-447d-9e59-3d66f4537fb8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:09.664394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 581/1166] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:21:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:09.670676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdce688-d8d3-48fe-8b3c-232173544f0c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:09.680335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdce688-d8d3-48fe-8b3c-232173544f0c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:09.684790 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f87b0-1a32-41ec-af0f-4085591d1144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:09.686634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f87b0-1a32-41ec-af0f-4085591d1144 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.686634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f87b0-1a32-41ec-af0f-4085591d1144 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.686841 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f87b0-1a32-41ec-af0f-4085591d1144 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.693488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f87b0-1a32-41ec-af0f-4085591d1144 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:09.695468 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f87b0-1a32-41ec-af0f-4085591d1144 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:09.709167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-c88f87b0-1a32-41ec-af0f-4085591d1144 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:21:09.710316 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 586/1167] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:21:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:09.716699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc814f5-02d8-447d-9e59-3d66f4537fb8 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:09.726403 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc814f5-02d8-447d-9e59-3d66f4537fb8 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:09.730923 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b3f49-5e0c-40e7-a375-fc44189ed6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:09.731558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b3f49-5e0c-40e7-a375-fc44189ed6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.731840 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b3f49-5e0c-40e7-a375-fc44189ed6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.732198 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b3f49-5e0c-40e7-a375-fc44189ed6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.732985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b3f49-5e0c-40e7-a375-fc44189ed6f1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:09.733288 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b3f49-5e0c-40e7-a375-fc44189ed6f1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:09.735134 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b3f49-5e0c-40e7-a375-fc44189ed6f1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:09.746657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 582/1168] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:21:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:21:09.753627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f87b0-1a32-41ec-af0f-4085591d1144 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:09.763129 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f87b0-1a32-41ec-af0f-4085591d1144 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:09.768345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b4583-e118-4d1d-8a28-ab101a0fbe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:09.769203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b4583-e118-4d1d-8a28-ab101a0fbe58 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:09.769481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b4583-e118-4d1d-8a28-ab101a0fbe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:09.769756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b4583-e118-4d1d-8a28-ab101a0fbe58 admin admin] PATH_INFO: `/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/b77a408df11844e2aacbb366019dc3d9/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:09.771710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b4583-e118-4d1d-8a28-ab101a0fbe58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c728e9160de45afbd4902c27eef45b3, user_id=b77a408df11844e2aacbb366019dc3d9, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:09.774402 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b4583-e118-4d1d-8a28-ab101a0fbe58 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:09.899912 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 587/1169] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Aug 29 14:21:09 2021] PUT /identity/v3/projects/7c728e9160de45afbd4902c27eef45b3/users/b77a408df11844e2aacbb366019dc3d9/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:21:12.088124 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619448e-7b16-40a3-9f0d-a4e297c55126 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.088631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619448e-7b16-40a3-9f0d-a4e297c55126 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.088716 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619448e-7b16-40a3-9f0d-a4e297c55126 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.090524 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 583/1170] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:21:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:21:12.096946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d9bc9-9bf5-48d3-bfc2-daa348433076 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.097386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d9bc9-9bf5-48d3-bfc2-daa348433076 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.097477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d9bc9-9bf5-48d3-bfc2-daa348433076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.115890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b56d9bc9-9bf5-48d3-bfc2-daa348433076 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:21:12.117978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b56d9bc9-9bf5-48d3-bfc2-daa348433076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:21:12.174988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 588/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:21:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:21:12.199614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619448e-7b16-40a3-9f0d-a4e297c55126 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:12.212677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619448e-7b16-40a3-9f0d-a4e297c55126 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:12.217711 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402790b0-ed10-4844-bc53-1ac24f2e4687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:12.218597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402790b0-ed10-4844-bc53-1ac24f2e4687 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.218897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402790b0-ed10-4844-bc53-1ac24f2e4687 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.219164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402790b0-ed10-4844-bc53-1ac24f2e4687 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.228961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402790b0-ed10-4844-bc53-1ac24f2e4687 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 14:21:12.235889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-402790b0-ed10-4844-bc53-1ac24f2e4687 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 14:21:12.237021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 584/1172] 10.222.0.16 () {56 vars in 1118 bytes} [Sun Aug 29 14:21:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:12.243764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d9bc9-9bf5-48d3-bfc2-daa348433076 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:12.252981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d9bc9-9bf5-48d3-bfc2-daa348433076 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:12.257507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505a0e9-da76-4f9f-9942-48795f593f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:12.258182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505a0e9-da76-4f9f-9942-48795f593f15 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.258459 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505a0e9-da76-4f9f-9942-48795f593f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.258727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505a0e9-da76-4f9f-9942-48795f593f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.259452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505a0e9-da76-4f9f-9942-48795f593f15 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:12.259750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505a0e9-da76-4f9f-9942-48795f593f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:12.261336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505a0e9-da76-4f9f-9942-48795f593f15 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:12.270006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 589/1173] 10.222.0.16 () {56 vars in 1121 bytes} [Sun Aug 29 14:21:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:12.276072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402790b0-ed10-4844-bc53-1ac24f2e4687 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:12.286919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402790b0-ed10-4844-bc53-1ac24f2e4687 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:12.291532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d9d99-2594-4401-859a-4bb6e869fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:12.292282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d9d99-2594-4401-859a-4bb6e869fbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.292562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d9d99-2594-4401-859a-4bb6e869fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.292907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d9d99-2594-4401-859a-4bb6e869fbb8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.302841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d9d99-2594-4401-859a-4bb6e869fbb8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:12.304777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d9d99-2594-4401-859a-4bb6e869fbb8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:12.320926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-430d9d99-2594-4401-859a-4bb6e869fbb8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:21:12.322143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 585/1174] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:12.329104 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505a0e9-da76-4f9f-9942-48795f593f15 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:12.338695 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505a0e9-da76-4f9f-9942-48795f593f15 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:12.344166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3b32f-422a-4555-ab12-f842a63a2ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:12.344810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3b32f-422a-4555-ab12-f842a63a2ddd admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.345086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3b32f-422a-4555-ab12-f842a63a2ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.345356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3b32f-422a-4555-ab12-f842a63a2ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.346133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3b32f-422a-4555-ab12-f842a63a2ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:12.346433 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3b32f-422a-4555-ab12-f842a63a2ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:12.348009 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3b32f-422a-4555-ab12-f842a63a2ddd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:12.359423 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 590/1175] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:21:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:12.365665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d9d99-2594-4401-859a-4bb6e869fbb8 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:12.375301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d9d99-2594-4401-859a-4bb6e869fbb8 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:12.380056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce5b4f-8482-4ad3-be8c-51a0e680b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:12.380921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce5b4f-8482-4ad3-be8c-51a0e680b9fb admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.381202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce5b4f-8482-4ad3-be8c-51a0e680b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.381473 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce5b4f-8482-4ad3-be8c-51a0e680b9fb admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.389012 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce5b4f-8482-4ad3-be8c-51a0e680b9fb admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:12.391287 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce5b4f-8482-4ad3-be8c-51a0e680b9fb admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:12.405898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-59ce5b4f-8482-4ad3-be8c-51a0e680b9fb admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 14:21:12.407018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 586/1176] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:12 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:12.413232 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3b32f-422a-4555-ab12-f842a63a2ddd admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:12.422921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3b32f-422a-4555-ab12-f842a63a2ddd admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:12.427480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133ff45-b000-4026-a5c4-f3a4014cf111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:12.428127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133ff45-b000-4026-a5c4-f3a4014cf111 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.428405 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133ff45-b000-4026-a5c4-f3a4014cf111 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.428677 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133ff45-b000-4026-a5c4-f3a4014cf111 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.429486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133ff45-b000-4026-a5c4-f3a4014cf111 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:12.429888 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133ff45-b000-4026-a5c4-f3a4014cf111 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:12.431702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133ff45-b000-4026-a5c4-f3a4014cf111 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:12.448230 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 591/1177] 10.222.0.16 () {56 vars in 1165 bytes} [Sun Aug 29 14:21:12 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:12.455166 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce5b4f-8482-4ad3-be8c-51a0e680b9fb admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:12.464837 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce5b4f-8482-4ad3-be8c-51a0e680b9fb admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:12.469813 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b079a-bbea-4995-b7d3-82dd620dcaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:12.470461 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b079a-bbea-4995-b7d3-82dd620dcaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.470740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b079a-bbea-4995-b7d3-82dd620dcaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.471377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b079a-bbea-4995-b7d3-82dd620dcaa3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.478638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b079a-bbea-4995-b7d3-82dd620dcaa3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:12.480343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b079a-bbea-4995-b7d3-82dd620dcaa3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:12.489177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 587/1178] 10.222.0.16 () {58 vars in 1325 bytes} [Sun Aug 29 14:21:12 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:21:12.495268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133ff45-b000-4026-a5c4-f3a4014cf111 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:12.505719 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133ff45-b000-4026-a5c4-f3a4014cf111 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:12.510376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea3ac2-1a14-4436-87ba-51e021c4a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:12.511146 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea3ac2-1a14-4436-87ba-51e021c4a09a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.511420 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea3ac2-1a14-4436-87ba-51e021c4a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.511688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea3ac2-1a14-4436-87ba-51e021c4a09a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.522209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea3ac2-1a14-4436-87ba-51e021c4a09a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:12.524020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea3ac2-1a14-4436-87ba-51e021c4a09a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:12.540052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-3bea3ac2-1a14-4436-87ba-51e021c4a09a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 14:21:12.541232 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 592/1179] 10.222.0.16 () {56 vars in 1130 bytes} [Sun Aug 29 14:21:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 14:21:12.548110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b079a-bbea-4995-b7d3-82dd620dcaa3 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:12.556930 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b079a-bbea-4995-b7d3-82dd620dcaa3 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:12.562092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae11a3-d90b-4731-a586-efd923ceb89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:12.562733 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae11a3-d90b-4731-a586-efd923ceb89b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.563019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae11a3-d90b-4731-a586-efd923ceb89b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.563287 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae11a3-d90b-4731-a586-efd923ceb89b admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.564082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae11a3-d90b-4731-a586-efd923ceb89b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:12.564380 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae11a3-d90b-4731-a586-efd923ceb89b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:12.565948 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae11a3-d90b-4731-a586-efd923ceb89b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:12.577551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 588/1180] 10.222.0.16 () {56 vars in 1131 bytes} [Sun Aug 29 14:21:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:12.583699 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea3ac2-1a14-4436-87ba-51e021c4a09a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:12.593312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea3ac2-1a14-4436-87ba-51e021c4a09a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:12.597779 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43218be1-1640-472e-a596-435eba6073d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:12.598573 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43218be1-1640-472e-a596-435eba6073d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.598850 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43218be1-1640-472e-a596-435eba6073d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.599123 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43218be1-1640-472e-a596-435eba6073d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.605697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43218be1-1640-472e-a596-435eba6073d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:12.607788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43218be1-1640-472e-a596-435eba6073d6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:12.620135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING keystone.server.flask.application [None req-43218be1-1640-472e-a596-435eba6073d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 14:21:12.621260 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 593/1181] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Aug 29 14:21:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:12.628414 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae11a3-d90b-4731-a586-efd923ceb89b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:12.637891 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae11a3-d90b-4731-a586-efd923ceb89b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:12.643219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1869ba-0827-47e6-a0ea-5fbeb25c9914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:12.646915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1869ba-0827-47e6-a0ea-5fbeb25c9914 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.646915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1869ba-0827-47e6-a0ea-5fbeb25c9914 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.646915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1869ba-0827-47e6-a0ea-5fbeb25c9914 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.646915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1869ba-0827-47e6-a0ea-5fbeb25c9914 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:12.646915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1869ba-0827-47e6-a0ea-5fbeb25c9914 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:12.647362 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1869ba-0827-47e6-a0ea-5fbeb25c9914 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:12.659231 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 589/1182] 10.222.0.16 () {56 vars in 1170 bytes} [Sun Aug 29 14:21:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:12.665635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43218be1-1640-472e-a596-435eba6073d6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:12.676740 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43218be1-1640-472e-a596-435eba6073d6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:12.681335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03390d9b-3e0e-4eb5-ab07-db2692639dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:12.682017 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03390d9b-3e0e-4eb5-ab07-db2692639dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:12.682301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03390d9b-3e0e-4eb5-ab07-db2692639dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:12.682572 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03390d9b-3e0e-4eb5-ab07-db2692639dc2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:12.683391 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03390d9b-3e0e-4eb5-ab07-db2692639dc2 admin admin] RBAC: Adding query filter params (role.id=4f40e52fa1fb462582ae0be8805efce6, scope.project.id=7c728e9160de45afbd4902c27eef45b3, user.id=b77a408df11844e2aacbb366019dc3d9) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:12.683699 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03390d9b-3e0e-4eb5-ab07-db2692639dc2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:12.686626 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03390d9b-3e0e-4eb5-ab07-db2692639dc2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:12.692350 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 594/1183] 10.222.0.16 () {56 vars in 1396 bytes} [Sun Aug 29 14:21:12 2021] GET /identity/v3/role_assignments?user.id=b77a408df11844e2aacbb366019dc3d9&scope.project.id=7c728e9160de45afbd4902c27eef45b3&role.id=4f40e52fa1fb462582ae0be8805efce6 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:14.894836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9852f93-19c2-48a8-a614-7247171b4f10 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:14.895380 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9852f93-19c2-48a8-a614-7247171b4f10 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:14.895380 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9852f93-19c2-48a8-a614-7247171b4f10 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:14.897131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 590/1184] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:21:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:21:14.902987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06a41-13aa-45cf-bac2-66969111cab3 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:14.903387 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06a41-13aa-45cf-bac2-66969111cab3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:14.903537 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06a41-13aa-45cf-bac2-66969111cab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:14.921700 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-eee06a41-13aa-45cf-bac2-66969111cab3 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:21:14.922910 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-eee06a41-13aa-45cf-bac2-66969111cab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:21:14.930727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 595/1185] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:21:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:21:14.955381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9852f93-19c2-48a8-a614-7247171b4f10 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:14.967419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9852f93-19c2-48a8-a614-7247171b4f10 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:14.971747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51059f8-89ac-4c34-8b80-0cb981c27c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:14.972521 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51059f8-89ac-4c34-8b80-0cb981c27c70 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:14.972795 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51059f8-89ac-4c34-8b80-0cb981c27c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:14.973065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51059f8-89ac-4c34-8b80-0cb981c27c70 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:14.973709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51059f8-89ac-4c34-8b80-0cb981c27c70 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:14.975302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51059f8-89ac-4c34-8b80-0cb981c27c70 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:14.986576 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-f51059f8-89ac-4c34-8b80-0cb981c27c70 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 14:21:14.987689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 591/1186] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Aug 29 14:21:14 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:14.994456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee06a41-13aa-45cf-bac2-66969111cab3 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:15.004742 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee06a41-13aa-45cf-bac2-66969111cab3 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:15.009315 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f08b5-e883-42a3-b9ce-a3f389a45ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:15.012896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f08b5-e883-42a3-b9ce-a3f389a45ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:15.012896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f08b5-e883-42a3-b9ce-a3f389a45ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:15.012896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f08b5-e883-42a3-b9ce-a3f389a45ab1 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:15.012896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f08b5-e883-42a3-b9ce-a3f389a45ab1 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:15.012896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f08b5-e883-42a3-b9ce-a3f389a45ab1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:15.013290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f08b5-e883-42a3-b9ce-a3f389a45ab1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:15.017908 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 596/1187] 10.222.0.16 () {56 vars in 1138 bytes} [Sun Aug 29 14:21:14 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:15.023997 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51059f8-89ac-4c34-8b80-0cb981c27c70 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:15.033430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51059f8-89ac-4c34-8b80-0cb981c27c70 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:15.038022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8eb0b1-c753-4ffd-884e-78af6c545181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:15.038656 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8eb0b1-c753-4ffd-884e-78af6c545181 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:15.038936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8eb0b1-c753-4ffd-884e-78af6c545181 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:15.039210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8eb0b1-c753-4ffd-884e-78af6c545181 admin admin] PATH_INFO: `/v3/services` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:15.039902 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8eb0b1-c753-4ffd-884e-78af6c545181 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:15.040205 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8eb0b1-c753-4ffd-884e-78af6c545181 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:15.041755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8eb0b1-c753-4ffd-884e-78af6c545181 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:15.046906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 592/1188] 10.222.0.16 () {56 vars in 1138 bytes} [Sun Aug 29 14:21:15 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:17.198144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6426544-0669-41a9-846d-ce3eaa262c07 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:17.198665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6426544-0669-41a9-846d-ce3eaa262c07 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:17.198781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6426544-0669-41a9-846d-ce3eaa262c07 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:17.200734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 597/1189] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:21:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:21:17.207229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cfc9c-3a73-4652-aac1-91fc643365d0 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:17.207634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cfc9c-3a73-4652-aac1-91fc643365d0 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:17.207725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cfc9c-3a73-4652-aac1-91fc643365d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:17.226144 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-663cfc9c-3a73-4652-aac1-91fc643365d0 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:21:17.227312 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-663cfc9c-3a73-4652-aac1-91fc643365d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:21:17.235064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 593/1190] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:21:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:21:17.259949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6426544-0669-41a9-846d-ce3eaa262c07 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:17.273225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6426544-0669-41a9-846d-ce3eaa262c07 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:17.282179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e19f0a-a296-4993-ac68-55cd33b55e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:17.282179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e19f0a-a296-4993-ac68-55cd33b55e90 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:17.282179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e19f0a-a296-4993-ac68-55cd33b55e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:17.282179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e19f0a-a296-4993-ac68-55cd33b55e90 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:17.282523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e19f0a-a296-4993-ac68-55cd33b55e90 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:17.282523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e19f0a-a296-4993-ac68-55cd33b55e90 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:17.376716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 598/1191] 10.222.0.16 () {60 vars in 1163 bytes} [Sun Aug 29 14:21:17 2021] POST /identity/v3/services => generated 246 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:21:19.574120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a4d3-7748-494b-88fc-fdbb4eb7927a None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:19.574710 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a4d3-7748-494b-88fc-fdbb4eb7927a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:19.574710 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a4d3-7748-494b-88fc-fdbb4eb7927a None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:19.576465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 594/1192] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:21:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:21:19.582437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c18ab5-b36e-4525-ab59-aaa217fca903 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:19.582828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c18ab5-b36e-4525-ab59-aaa217fca903 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:19.582993 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c18ab5-b36e-4525-ab59-aaa217fca903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:19.600310 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d8c18ab5-b36e-4525-ab59-aaa217fca903 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:21:19.601485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d8c18ab5-b36e-4525-ab59-aaa217fca903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:21:19.618492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 599/1193] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:21:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:21:19.643182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a4d3-7748-494b-88fc-fdbb4eb7927a None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:19.655662 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a4d3-7748-494b-88fc-fdbb4eb7927a None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:19.660112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363dbb6-ba60-4508-8fee-82fed30cac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:19.660957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363dbb6-ba60-4508-8fee-82fed30cac0c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:19.661331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363dbb6-ba60-4508-8fee-82fed30cac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:19.661611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363dbb6-ba60-4508-8fee-82fed30cac0c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:19.662289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363dbb6-ba60-4508-8fee-82fed30cac0c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:19.663863 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363dbb6-ba60-4508-8fee-82fed30cac0c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:19.675267 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-7363dbb6-ba60-4508-8fee-82fed30cac0c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 14:21:19.676371 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 595/1194] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Aug 29 14:21:19 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:19.682787 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c18ab5-b36e-4525-ab59-aaa217fca903 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:19.691559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c18ab5-b36e-4525-ab59-aaa217fca903 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:19.696174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635efec-0e48-4dbf-b525-eba7839bbe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:19.696818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635efec-0e48-4dbf-b525-eba7839bbe97 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:19.697093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635efec-0e48-4dbf-b525-eba7839bbe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:19.697368 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635efec-0e48-4dbf-b525-eba7839bbe97 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:19.698087 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635efec-0e48-4dbf-b525-eba7839bbe97 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:19.698388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635efec-0e48-4dbf-b525-eba7839bbe97 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:19.699984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635efec-0e48-4dbf-b525-eba7839bbe97 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:19.705024 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 600/1195] 10.222.0.16 () {56 vars in 1138 bytes} [Sun Aug 29 14:21:19 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:19.711156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363dbb6-ba60-4508-8fee-82fed30cac0c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:19.721670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363dbb6-ba60-4508-8fee-82fed30cac0c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:19.726239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0723e8-0df8-45e5-9d96-99e430aacb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:19.726866 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0723e8-0df8-45e5-9d96-99e430aacb06 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:19.727191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0723e8-0df8-45e5-9d96-99e430aacb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:19.727464 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0723e8-0df8-45e5-9d96-99e430aacb06 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:19.728230 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0723e8-0df8-45e5-9d96-99e430aacb06 admin admin] RBAC: Adding query filter params (interface=public, service_id=d33e35c4ac71422b8aa6301a55e779e2, region_id=RegionOne) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:19.728537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0723e8-0df8-45e5-9d96-99e430aacb06 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:19.730127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0723e8-0df8-45e5-9d96-99e430aacb06 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:19.735496 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 596/1196] 10.222.0.16 () {56 vars in 1273 bytes} [Sun Aug 29 14:21:19 2021] GET /identity/v3/endpoints?service_id=d33e35c4ac71422b8aa6301a55e779e2&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:21:19.741534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635efec-0e48-4dbf-b525-eba7839bbe97 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:19.751002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635efec-0e48-4dbf-b525-eba7839bbe97 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:19.755746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2f4d9-e264-4126-b870-e3d02faff749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:19.756392 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f4d9-e264-4126-b870-e3d02faff749 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:19.756672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f4d9-e264-4126-b870-e3d02faff749 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:19.756941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f4d9-e264-4126-b870-e3d02faff749 admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:19.757609 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2f4d9-e264-4126-b870-e3d02faff749 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:19.759211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2f4d9-e264-4126-b870-e3d02faff749 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:19.766249 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 601/1197] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Aug 29 14:21:19 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:21:21.919152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26003ea-3712-4b55-8df3-83d5120b02cc None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:21.919905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26003ea-3712-4b55-8df3-83d5120b02cc None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:21.919905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26003ea-3712-4b55-8df3-83d5120b02cc None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:21.922185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 597/1198] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:21:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:21:21.928034 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc43f8-934c-401c-8b20-c1b0352d90c7 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:21.928461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc43f8-934c-401c-8b20-c1b0352d90c7 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:21.928602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc43f8-934c-401c-8b20-c1b0352d90c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:21.946136 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-26cc43f8-934c-401c-8b20-c1b0352d90c7 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:21:21.951116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-26cc43f8-934c-401c-8b20-c1b0352d90c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:21:21.955065 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 602/1199] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:21:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:21:21.980817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26003ea-3712-4b55-8df3-83d5120b02cc None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:21.993727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26003ea-3712-4b55-8df3-83d5120b02cc None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:21.998257 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbebcc-64e7-4df5-a811-6b0e3ab3bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:21.999046 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbebcc-64e7-4df5-a811-6b0e3ab3bd52 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:21.999309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbebcc-64e7-4df5-a811-6b0e3ab3bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:21.999581 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbebcc-64e7-4df5-a811-6b0e3ab3bd52 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:22.000219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbebcc-64e7-4df5-a811-6b0e3ab3bd52 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:22.001785 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbebcc-64e7-4df5-a811-6b0e3ab3bd52 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:22.012732 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING keystone.server.flask.application [None req-f2dbebcc-64e7-4df5-a811-6b0e3ab3bd52 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 14:21:22.013848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 598/1200] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Aug 29 14:21:21 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 14:21:22.020670 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc43f8-934c-401c-8b20-c1b0352d90c7 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:22.029997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc43f8-934c-401c-8b20-c1b0352d90c7 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:22.035643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e91eec-c1d6-429f-9ce7-270c8c3317fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:22.035643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e91eec-c1d6-429f-9ce7-270c8c3317fe admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:22.035643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e91eec-c1d6-429f-9ce7-270c8c3317fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:22.035643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e91eec-c1d6-429f-9ce7-270c8c3317fe admin admin] PATH_INFO: `/v3/services` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:22.036279 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e91eec-c1d6-429f-9ce7-270c8c3317fe admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:21:22.036579 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e91eec-c1d6-429f-9ce7-270c8c3317fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:22.038175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e91eec-c1d6-429f-9ce7-270c8c3317fe admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:22.043088 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 603/1201] 10.222.0.16 () {56 vars in 1138 bytes} [Sun Aug 29 14:21:22 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:21:22.049731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbebcc-64e7-4df5-a811-6b0e3ab3bd52 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:21:22.059921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbebcc-64e7-4df5-a811-6b0e3ab3bd52 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:21:22.064498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dff75-adf1-4e15-977b-66d3ce20513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:21:22.069928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dff75-adf1-4e15-977b-66d3ce20513a admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:21:22.069928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dff75-adf1-4e15-977b-66d3ce20513a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:21:22.069928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dff75-adf1-4e15-977b-66d3ce20513a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:21:22.069928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dff75-adf1-4e15-977b-66d3ce20513a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:21:22.069928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dff75-adf1-4e15-977b-66d3ce20513a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:21:22.188762 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 599/1202] 10.222.0.16 () {60 vars in 1166 bytes} [Sun Aug 29 14:21:22 2021] POST /identity/v3/endpoints => generated 331 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:27:48.543263 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d48c4e-c725-4a63-92c8-8cb59b3c01f3 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:48.544183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d48c4e-c725-4a63-92c8-8cb59b3c01f3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:48.544601 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d48c4e-c725-4a63-92c8-8cb59b3c01f3 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:48.546538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 604/1203] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:27:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:27:48.552547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ab41-af4a-4120-845f-fbaf84783633 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:48.555769 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ab41-af4a-4120-845f-fbaf84783633 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:48.556381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897ab41-af4a-4120-845f-fbaf84783633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:48.710394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-6897ab41-af4a-4120-845f-fbaf84783633 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:27:48.712429 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-6897ab41-af4a-4120-845f-fbaf84783633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:48.889468 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 600/1204] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:27:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:27:48.910767 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d48c4e-c725-4a63-92c8-8cb59b3c01f3 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:27:48.912637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a1d48c4e-c725-4a63-92c8-8cb59b3c01f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:49.066524 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d48c4e-c725-4a63-92c8-8cb59b3c01f3 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:27:49.165642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ff5c7-9c83-47d3-a244-6442de681b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:27:49.166578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ff5c7-9c83-47d3-a244-6442de681b54 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:49.167045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ff5c7-9c83-47d3-a244-6442de681b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:49.167464 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ff5c7-9c83-47d3-a244-6442de681b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:49.168372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ff5c7-9c83-47d3-a244-6442de681b54 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:27:49.170525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ff5c7-9c83-47d3-a244-6442de681b54 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:27:49.190935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 605/1205] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Aug 29 14:27:48 2021] GET /identity/v3/projects => generated 2553 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:27:51.392101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e849b91-b08f-46c9-9d0a-56f86ef975ae None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:51.392631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e849b91-b08f-46c9-9d0a-56f86ef975ae None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:51.392631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e849b91-b08f-46c9-9d0a-56f86ef975ae None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:51.394457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 601/1206] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:27:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:27:51.401515 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c31c0c-ef75-49c6-ae69-92042fe3fa32 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:51.401972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c31c0c-ef75-49c6-ae69-92042fe3fa32 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:51.402113 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c31c0c-ef75-49c6-ae69-92042fe3fa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:51.471027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-64c31c0c-ef75-49c6-ae69-92042fe3fa32 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:27:51.472243 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-64c31c0c-ef75-49c6-ae69-92042fe3fa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:51.567135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 606/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:27:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:27:51.616939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35c20-99c0-4cca-a5df-18ffb31d1cd6 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:51.618534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35c20-99c0-4cca-a5df-18ffb31d1cd6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:51.619164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35c20-99c0-4cca-a5df-18ffb31d1cd6 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:51.620616 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 602/1208] 10.222.0.16 () {54 vars in 964 bytes} [Sun Aug 29 14:27:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:27:51.627089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81166ead-59eb-47bc-81f0-3c7b34f44cfe None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:51.627384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81166ead-59eb-47bc-81f0-3c7b34f44cfe None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:51.627666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81166ead-59eb-47bc-81f0-3c7b34f44cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:51.701734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-81166ead-59eb-47bc-81f0-3c7b34f44cfe None None] MFA Rules not processed for user `f13a39de23f04cb0a2f5b050d740334a`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:27:51.702965 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-81166ead-59eb-47bc-81f0-3c7b34f44cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:51.779518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 607/1209] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Aug 29 14:27:51 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:27:51.788549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e35c20-99c0-4cca-a5df-18ffb31d1cd6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:27:51.790318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-49e35c20-99c0-4cca-a5df-18ffb31d1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:51.889040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e35c20-99c0-4cca-a5df-18ffb31d1cd6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:27:51.961628 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745748a-a8d1-45cd-876d-1c773b5045ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:27:51.962321 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745748a-a8d1-45cd-876d-1c773b5045ec service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:51.962604 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745748a-a8d1-45cd-876d-1c773b5045ec service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:51.962874 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745748a-a8d1-45cd-876d-1c773b5045ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:51.964468 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8745748a-a8d1-45cd-876d-1c773b5045ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:52.069050 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745748a-a8d1-45cd-876d-1c773b5045ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:27:52.070538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745748a-a8d1-45cd-876d-1c773b5045ec service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:27:52.088676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 603/1210] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:27:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:27:54.515477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647a5f2-359d-47d4-a8aa-59bb1ff31424 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:54.516005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647a5f2-359d-47d4-a8aa-59bb1ff31424 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:54.516005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647a5f2-359d-47d4-a8aa-59bb1ff31424 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:54.517789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 608/1211] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:27:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:27:54.523694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec21ad-06d2-4405-9314-ced5a5f25e45 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:54.524698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec21ad-06d2-4405-9314-ced5a5f25e45 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:54.524887 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec21ad-06d2-4405-9314-ced5a5f25e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:54.587633 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-ffec21ad-06d2-4405-9314-ced5a5f25e45 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:27:54.588828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ffec21ad-06d2-4405-9314-ced5a5f25e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:54.677674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 604/1212] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:27:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:27:54.716668 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647a5f2-359d-47d4-a8aa-59bb1ff31424 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:27:54.718194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a647a5f2-359d-47d4-a8aa-59bb1ff31424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:54.817615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647a5f2-359d-47d4-a8aa-59bb1ff31424 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:27:54.886934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5f8e1-0c1b-4c7b-8cd5-40b8c7ae593b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:27:54.887577 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5f8e1-0c1b-4c7b-8cd5-40b8c7ae593b service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:54.887856 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5f8e1-0c1b-4c7b-8cd5-40b8c7ae593b service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:54.888128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5f8e1-0c1b-4c7b-8cd5-40b8c7ae593b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:54.889742 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-cde5f8e1-0c1b-4c7b-8cd5-40b8c7ae593b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:54.991657 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5f8e1-0c1b-4c7b-8cd5-40b8c7ae593b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:27:54.993129 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5f8e1-0c1b-4c7b-8cd5-40b8c7ae593b service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:27:55.011721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 609/1213] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:27:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:27:57.698460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa2fa2-87fc-4b6d-956a-4ac15642726d None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:57.699014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa2fa2-87fc-4b6d-956a-4ac15642726d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:57.699014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa2fa2-87fc-4b6d-956a-4ac15642726d None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:57.700780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 605/1214] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:27:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:27:57.706666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e84cd-49c8-4a26-9724-12ce0057063d None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:57.707067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e84cd-49c8-4a26-9724-12ce0057063d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:57.707204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e84cd-49c8-4a26-9724-12ce0057063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:57.769444 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-ca4e84cd-49c8-4a26-9724-12ce0057063d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:27:57.770663 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ca4e84cd-49c8-4a26-9724-12ce0057063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:57.862141 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 610/1215] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:27:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:27:57.898081 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa2fa2-87fc-4b6d-956a-4ac15642726d None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:27:57.899705 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-fbfa2fa2-87fc-4b6d-956a-4ac15642726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:58.019161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa2fa2-87fc-4b6d-956a-4ac15642726d None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:27:58.106138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb4baf-9526-40a8-aa5c-4ccf7aaf8f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:27:58.106978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb4baf-9526-40a8-aa5c-4ccf7aaf8f60 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:58.107249 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb4baf-9526-40a8-aa5c-4ccf7aaf8f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:58.107512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb4baf-9526-40a8-aa5c-4ccf7aaf8f60 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:58.117152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb4baf-9526-40a8-aa5c-4ccf7aaf8f60 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:27:58.120177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb4baf-9526-40a8-aa5c-4ccf7aaf8f60 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:27:58.122618 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 606/1216] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:27:57 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:27:58.135376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e84cd-49c8-4a26-9724-12ce0057063d None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:27:58.136583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ca4e84cd-49c8-4a26-9724-12ce0057063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:58.223523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e84cd-49c8-4a26-9724-12ce0057063d None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:27:58.294927 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec421ad8-1c9c-41be-918c-64a228d739a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:27:58.295581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec421ad8-1c9c-41be-918c-64a228d739a4 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:27:58.295862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec421ad8-1c9c-41be-918c-64a228d739a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:27:58.296135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec421ad8-1c9c-41be-918c-64a228d739a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:27:58.297752 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ec421ad8-1c9c-41be-918c-64a228d739a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:27:58.408201 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec421ad8-1c9c-41be-918c-64a228d739a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:27:58.409647 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec421ad8-1c9c-41be-918c-64a228d739a4 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:27:58.426965 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 611/1217] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:27:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:01.391501 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5bd09-e5b7-4f75-9e7d-4b8d6ec970a0 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:01.392098 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5bd09-e5b7-4f75-9e7d-4b8d6ec970a0 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:01.392098 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5bd09-e5b7-4f75-9e7d-4b8d6ec970a0 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:01.393817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 607/1218] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:01.399586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc520e8-e9e3-4416-9ee2-ea13bafd6609 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:01.399987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc520e8-e9e3-4416-9ee2-ea13bafd6609 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:01.400712 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc520e8-e9e3-4416-9ee2-ea13bafd6609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:01.463304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-4fc520e8-e9e3-4416-9ee2-ea13bafd6609 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:01.464482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4fc520e8-e9e3-4416-9ee2-ea13bafd6609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:01.553892 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 612/1219] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:01.588964 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5bd09-e5b7-4f75-9e7d-4b8d6ec970a0 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:01.590500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-71c5bd09-e5b7-4f75-9e7d-4b8d6ec970a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:01.707417 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5bd09-e5b7-4f75-9e7d-4b8d6ec970a0 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:01.795422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69fd6b-5caf-4718-9e13-d24d18c9166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:01.796254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69fd6b-5caf-4718-9e13-d24d18c9166e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:01.796534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69fd6b-5caf-4718-9e13-d24d18c9166e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:01.796807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69fd6b-5caf-4718-9e13-d24d18c9166e admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:01.806367 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69fd6b-5caf-4718-9e13-d24d18c9166e admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:01.808384 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69fd6b-5caf-4718-9e13-d24d18c9166e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:01.810065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 608/1220] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:28:01 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:28:01.822277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc520e8-e9e3-4416-9ee2-ea13bafd6609 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:01.823474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4fc520e8-e9e3-4416-9ee2-ea13bafd6609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:01.914373 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc520e8-e9e3-4416-9ee2-ea13bafd6609 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:01.985171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e961c-f286-4163-a18f-776f1cdb74e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:01.985746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e961c-f286-4163-a18f-776f1cdb74e1 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:01.986053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e961c-f286-4163-a18f-776f1cdb74e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:01.986327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e961c-f286-4163-a18f-776f1cdb74e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:01.987944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e18e961c-f286-4163-a18f-776f1cdb74e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:02.092711 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e961c-f286-4163-a18f-776f1cdb74e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:02.094171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e961c-f286-4163-a18f-776f1cdb74e1 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:02.111804 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 613/1221] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:05.313669 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af05f4-deee-4cb1-8310-d174267e3a5b None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:05.314282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af05f4-deee-4cb1-8310-d174267e3a5b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:05.314282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af05f4-deee-4cb1-8310-d174267e3a5b None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:05.316019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 609/1222] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:05.322029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a65e84-0ed7-4146-839b-e203a6fa63d2 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:05.322425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a65e84-0ed7-4146-839b-e203a6fa63d2 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:05.322597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a65e84-0ed7-4146-839b-e203a6fa63d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:05.385518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-71a65e84-0ed7-4146-839b-e203a6fa63d2 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:05.386753 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-71a65e84-0ed7-4146-839b-e203a6fa63d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:05.482669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 614/1223] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:05.537202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c53dd7-a1a5-4c1b-8524-b3f729cb6f1b None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:05.537491 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c53dd7-a1a5-4c1b-8524-b3f729cb6f1b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:05.537766 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c53dd7-a1a5-4c1b-8524-b3f729cb6f1b None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:05.539594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 610/1224] 10.222.0.16 () {54 vars in 964 bytes} [Sun Aug 29 14:28:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:05.546649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae3f33-ed68-44c7-9757-c2943de30c13 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:05.547091 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae3f33-ed68-44c7-9757-c2943de30c13 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:05.547436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae3f33-ed68-44c7-9757-c2943de30c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:05.627509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0dae3f33-ed68-44c7-9757-c2943de30c13 None None] MFA Rules not processed for user `f13a39de23f04cb0a2f5b050d740334a`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:05.628684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0dae3f33-ed68-44c7-9757-c2943de30c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:05.703944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 615/1225] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Aug 29 14:28:05 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:05.713152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c53dd7-a1a5-4c1b-8524-b3f729cb6f1b None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:05.714813 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a2c53dd7-a1a5-4c1b-8524-b3f729cb6f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:05.817670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c53dd7-a1a5-4c1b-8524-b3f729cb6f1b None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:05.887847 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dad38-bde3-4343-ae18-b3d3665a44e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:05.888415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dad38-bde3-4343-ae18-b3d3665a44e4 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:05.888695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dad38-bde3-4343-ae18-b3d3665a44e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:05.888965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dad38-bde3-4343-ae18-b3d3665a44e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:05.890600 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-3c7dad38-bde3-4343-ae18-b3d3665a44e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:06.002207 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7dad38-bde3-4343-ae18-b3d3665a44e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:06.003639 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7dad38-bde3-4343-ae18-b3d3665a44e4 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:06.020658 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 611/1226] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:08.444721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be9a8d-1b70-48f3-806d-d5934b2dd90b None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:08.445259 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be9a8d-1b70-48f3-806d-d5934b2dd90b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:08.445259 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be9a8d-1b70-48f3-806d-d5934b2dd90b None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:08.447198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 616/1227] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:28:08.453140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfa5c3-2e0e-47a0-ae46-2ecb02bda685 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:08.453580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfa5c3-2e0e-47a0-ae46-2ecb02bda685 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:08.453767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfa5c3-2e0e-47a0-ae46-2ecb02bda685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:08.517158 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-32bfa5c3-2e0e-47a0-ae46-2ecb02bda685 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:08.518382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-32bfa5c3-2e0e-47a0-ae46-2ecb02bda685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:08.608926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 612/1228] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:08.646125 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be9a8d-1b70-48f3-806d-d5934b2dd90b None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:08.647640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-84be9a8d-1b70-48f3-806d-d5934b2dd90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:08.751125 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be9a8d-1b70-48f3-806d-d5934b2dd90b None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:08.822989 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1527db-f271-4be8-ba5d-81a1d79de008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:08.823639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1527db-f271-4be8-ba5d-81a1d79de008 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:08.823923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1527db-f271-4be8-ba5d-81a1d79de008 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:08.824199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1527db-f271-4be8-ba5d-81a1d79de008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:08.825824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-6b1527db-f271-4be8-ba5d-81a1d79de008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:08.935301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1527db-f271-4be8-ba5d-81a1d79de008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:08.936889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1527db-f271-4be8-ba5d-81a1d79de008 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:08.955580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 617/1229] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:11.200354 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19175c71-5ee6-4506-a7a0-613df3c71db6 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:11.200871 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19175c71-5ee6-4506-a7a0-613df3c71db6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:11.200871 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19175c71-5ee6-4506-a7a0-613df3c71db6 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:11.202611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 613/1230] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:11.208667 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bb503-447a-482a-ad47-97f346603a10 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:11.209099 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bb503-447a-482a-ad47-97f346603a10 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:11.209228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bb503-447a-482a-ad47-97f346603a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:11.285272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b92bb503-447a-482a-ad47-97f346603a10 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:11.286534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b92bb503-447a-482a-ad47-97f346603a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:11.378580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 618/1231] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:28:11.411985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19175c71-5ee6-4506-a7a0-613df3c71db6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:11.413505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-19175c71-5ee6-4506-a7a0-613df3c71db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:11.532539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19175c71-5ee6-4506-a7a0-613df3c71db6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:11.623792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe2d75-e61a-4310-b068-00443773624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:11.624648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe2d75-e61a-4310-b068-00443773624a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:11.624931 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe2d75-e61a-4310-b068-00443773624a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:11.625208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe2d75-e61a-4310-b068-00443773624a admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:11.635447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe2d75-e61a-4310-b068-00443773624a admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:11.637505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe2d75-e61a-4310-b068-00443773624a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:11.639223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 614/1232] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:28:11 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:28:11.652019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bb503-447a-482a-ad47-97f346603a10 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:11.653279 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b92bb503-447a-482a-ad47-97f346603a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:11.749578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bb503-447a-482a-ad47-97f346603a10 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:11.824421 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef15b9-7535-40b8-89e3-b967dac7458a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:11.825082 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef15b9-7535-40b8-89e3-b967dac7458a service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:11.825364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef15b9-7535-40b8-89e3-b967dac7458a service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:11.825638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef15b9-7535-40b8-89e3-b967dac7458a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:11.827418 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ddef15b9-7535-40b8-89e3-b967dac7458a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:11.933794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef15b9-7535-40b8-89e3-b967dac7458a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:11.935344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef15b9-7535-40b8-89e3-b967dac7458a service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:11.955707 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 619/1233] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:14.730060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e7b15-dfc8-49b4-b503-01738efb63a6 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:14.730595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e7b15-dfc8-49b4-b503-01738efb63a6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:14.730595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e7b15-dfc8-49b4-b503-01738efb63a6 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:14.732343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 615/1234] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:14.738285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb186c3-304b-4530-8b97-9c959c558c54 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:14.738720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb186c3-304b-4530-8b97-9c959c558c54 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:14.738842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb186c3-304b-4530-8b97-9c959c558c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:14.801877 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-4bb186c3-304b-4530-8b97-9c959c558c54 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:14.803133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4bb186c3-304b-4530-8b97-9c959c558c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:14.896377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 620/1235] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:28:14.933311 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e7b15-dfc8-49b4-b503-01738efb63a6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:14.934881 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-2f7e7b15-dfc8-49b4-b503-01738efb63a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:15.033087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e7b15-dfc8-49b4-b503-01738efb63a6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:15.102449 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba3943-991b-4803-86ae-4ac59fabf3d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:15.103149 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba3943-991b-4803-86ae-4ac59fabf3d6 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:15.103529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba3943-991b-4803-86ae-4ac59fabf3d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:15.103817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba3943-991b-4803-86ae-4ac59fabf3d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:15.105448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c0ba3943-991b-4803-86ae-4ac59fabf3d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:15.210035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba3943-991b-4803-86ae-4ac59fabf3d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:15.211496 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba3943-991b-4803-86ae-4ac59fabf3d6 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:15.228713 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 616/1236] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:17.528013 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bd27e-4bf8-4836-98f1-65b790c22a4a None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:17.528549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bd27e-4bf8-4836-98f1-65b790c22a4a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:17.528549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bd27e-4bf8-4836-98f1-65b790c22a4a None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:17.530372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 621/1237] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:17.536125 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c237f2-2e95-4b88-964a-be76cb1c4103 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:17.536559 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c237f2-2e95-4b88-964a-be76cb1c4103 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:17.536653 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c237f2-2e95-4b88-964a-be76cb1c4103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:17.598659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f9c237f2-2e95-4b88-964a-be76cb1c4103 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:17.599865 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f9c237f2-2e95-4b88-964a-be76cb1c4103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:17.692474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 617/1238] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:17.735272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bd27e-4bf8-4836-98f1-65b790c22a4a None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:17.736227 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1f2bd27e-4bf8-4836-98f1-65b790c22a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:17.835053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bd27e-4bf8-4836-98f1-65b790c22a4a None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:17.905404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018cd11-876b-413f-b989-3bc9e6d96077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:17.906075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018cd11-876b-413f-b989-3bc9e6d96077 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:17.906357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018cd11-876b-413f-b989-3bc9e6d96077 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:17.906628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018cd11-876b-413f-b989-3bc9e6d96077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:17.908419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b018cd11-876b-413f-b989-3bc9e6d96077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:18.012294 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018cd11-876b-413f-b989-3bc9e6d96077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:18.013726 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018cd11-876b-413f-b989-3bc9e6d96077 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:18.031570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 622/1239] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:20.854929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe953fb-df37-40e2-b901-8089d451066e None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:20.855489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe953fb-df37-40e2-b901-8089d451066e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:20.855489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe953fb-df37-40e2-b901-8089d451066e None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:20.857225 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 618/1240] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:20.863127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c314-72e1-4167-b146-3c4bd5a9c9ba None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:20.863567 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c314-72e1-4167-b146-3c4bd5a9c9ba None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:20.863677 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c314-72e1-4167-b146-3c4bd5a9c9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:20.937290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3fe0c314-72e1-4167-b146-3c4bd5a9c9ba None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:20.938495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3fe0c314-72e1-4167-b146-3c4bd5a9c9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:21.040438 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 623/1241] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:21.077051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe953fb-df37-40e2-b901-8089d451066e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:21.079212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7fe953fb-df37-40e2-b901-8089d451066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:21.169329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe953fb-df37-40e2-b901-8089d451066e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:21.172783 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089fed0-a91d-46a2-b389-20e913018375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:21.173413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089fed0-a91d-46a2-b389-20e913018375 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:21.173687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089fed0-a91d-46a2-b389-20e913018375 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:21.173988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089fed0-a91d-46a2-b389-20e913018375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:21.182641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089fed0-a91d-46a2-b389-20e913018375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:21.184041 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089fed0-a91d-46a2-b389-20e913018375 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:21.193008 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 619/1242] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:25.509913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd688cfe-7761-4fd1-8bc1-c81d4f7799ae None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:25.510462 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd688cfe-7761-4fd1-8bc1-c81d4f7799ae None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:25.510462 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd688cfe-7761-4fd1-8bc1-c81d4f7799ae None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:25.512227 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 624/1243] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:25.518082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e604b1-a3df-4d84-b115-0dd008e8f876 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:25.518526 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e604b1-a3df-4d84-b115-0dd008e8f876 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:25.518666 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e604b1-a3df-4d84-b115-0dd008e8f876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:25.536763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-96e604b1-a3df-4d84-b115-0dd008e8f876 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:25.537980 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-96e604b1-a3df-4d84-b115-0dd008e8f876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:25.546439 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 620/1244] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:25.585646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd688cfe-7761-4fd1-8bc1-c81d4f7799ae None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:25.596676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd688cfe-7761-4fd1-8bc1-c81d4f7799ae None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:25.600272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae471472-e5bd-494f-bec9-9658fd032519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:25.600976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae471472-e5bd-494f-bec9-9658fd032519 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:25.601320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae471472-e5bd-494f-bec9-9658fd032519 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:25.601751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae471472-e5bd-494f-bec9-9658fd032519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:25.610867 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae471472-e5bd-494f-bec9-9658fd032519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:25.612379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae471472-e5bd-494f-bec9-9658fd032519 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:25.622551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 625/1245] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:28.767357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05461-13c8-4d58-aebf-14aa78b32c97 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:28.767919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05461-13c8-4d58-aebf-14aa78b32c97 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:28.767919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05461-13c8-4d58-aebf-14aa78b32c97 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:28.770708 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 621/1246] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:28.777403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7918a7-7999-4754-8c4e-1a1d57d8d9fb None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:28.777856 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7918a7-7999-4754-8c4e-1a1d57d8d9fb None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:28.778019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7918a7-7999-4754-8c4e-1a1d57d8d9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:28.796598 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-ae7918a7-7999-4754-8c4e-1a1d57d8d9fb None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:28.797790 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ae7918a7-7999-4754-8c4e-1a1d57d8d9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:28.805807 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 626/1247] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:28.845235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f05461-13c8-4d58-aebf-14aa78b32c97 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:28.847153 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-78f05461-13c8-4d58-aebf-14aa78b32c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:28.860969 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f05461-13c8-4d58-aebf-14aa78b32c97 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:28.864584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dba138-03cf-40fd-a06c-4ba9efb94714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:28.865248 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dba138-03cf-40fd-a06c-4ba9efb94714 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:28.865623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dba138-03cf-40fd-a06c-4ba9efb94714 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:28.865931 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dba138-03cf-40fd-a06c-4ba9efb94714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:28.876344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dba138-03cf-40fd-a06c-4ba9efb94714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:28.877776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dba138-03cf-40fd-a06c-4ba9efb94714 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:28.889123 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 622/1248] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:33.641029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113018e-795e-4d30-8abc-6f2a58884bfb None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:33.641587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113018e-795e-4d30-8abc-6f2a58884bfb None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:33.641587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113018e-795e-4d30-8abc-6f2a58884bfb None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:33.643379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 627/1249] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:33.649831 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120b242-f271-42eb-9773-d88cd0f0eadd None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:33.650315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120b242-f271-42eb-9773-d88cd0f0eadd None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:33.650410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120b242-f271-42eb-9773-d88cd0f0eadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:33.668096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-6120b242-f271-42eb-9773-d88cd0f0eadd None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:33.669290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-6120b242-f271-42eb-9773-d88cd0f0eadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:33.676975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 623/1250] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:33.716354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113018e-795e-4d30-8abc-6f2a58884bfb None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:33.727224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113018e-795e-4d30-8abc-6f2a58884bfb None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:33.730707 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca44fe-21fd-44df-a2bb-eaf81ddcf6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:33.731338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca44fe-21fd-44df-a2bb-eaf81ddcf6fd service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:33.731616 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca44fe-21fd-44df-a2bb-eaf81ddcf6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:33.731886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca44fe-21fd-44df-a2bb-eaf81ddcf6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:33.740576 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca44fe-21fd-44df-a2bb-eaf81ddcf6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:33.742628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca44fe-21fd-44df-a2bb-eaf81ddcf6fd service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:33.752022 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 628/1251] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:39.002642 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b78ff-e959-4172-aba6-8fdaea2d6644 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:39.003568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b78ff-e959-4172-aba6-8fdaea2d6644 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:39.004014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b78ff-e959-4172-aba6-8fdaea2d6644 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:39.006378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 624/1252] 10.222.0.16 () {54 vars in 921 bytes} [Sun Aug 29 14:28:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:39.012154 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b01f74-b2ec-48a2-949e-f767ee70af1d None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:39.022449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b01f74-b2ec-48a2-949e-f767ee70af1d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:39.022449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b01f74-b2ec-48a2-949e-f767ee70af1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:39.084878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-22b01f74-b2ec-48a2-949e-f767ee70af1d None None] MFA Rules not processed for user `b77a408df11844e2aacbb366019dc3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:39.086274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-22b01f74-b2ec-48a2-949e-f767ee70af1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:39.164494 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 629/1253] 10.222.0.16 () {58 vars in 1019 bytes} [Sun Aug 29 14:28:39 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:43.423128 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e976-1b27-463e-b454-b09ed5d26230 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:43.423691 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e976-1b27-463e-b454-b09ed5d26230 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:43.423691 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e976-1b27-463e-b454-b09ed5d26230 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:43.425595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 625/1254] 10.222.0.16 () {54 vars in 921 bytes} [Sun Aug 29 14:28:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:43.431345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edf3a9-ef07-48fa-87c0-6d0caaea1af2 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:43.432096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edf3a9-ef07-48fa-87c0-6d0caaea1af2 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:43.432374 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edf3a9-ef07-48fa-87c0-6d0caaea1af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:43.451090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c6edf3a9-ef07-48fa-87c0-6d0caaea1af2 None None] MFA Rules not processed for user `b77a408df11844e2aacbb366019dc3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:43.452371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c6edf3a9-ef07-48fa-87c0-6d0caaea1af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:43.461957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 630/1255] 10.222.0.16 () {58 vars in 1019 bytes} [Sun Aug 29 14:28:43 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:44.924461 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ba946-26a7-4e4a-96d6-1aac5c73b3df None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:44.924963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ba946-26a7-4e4a-96d6-1aac5c73b3df None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:44.925040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ba946-26a7-4e4a-96d6-1aac5c73b3df None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:44.926807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 626/1256] 10.222.0.16 () {54 vars in 921 bytes} [Sun Aug 29 14:28:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:44.932085 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8bae9-bb3f-4796-8681-91c4c892af20 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:44.932508 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8bae9-bb3f-4796-8681-91c4c892af20 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:44.932830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8bae9-bb3f-4796-8681-91c4c892af20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:44.950946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-bab8bae9-bb3f-4796-8681-91c4c892af20 None None] MFA Rules not processed for user `b77a408df11844e2aacbb366019dc3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:44.952388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-bab8bae9-bb3f-4796-8681-91c4c892af20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:44.962084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 631/1257] 10.222.0.16 () {58 vars in 1019 bytes} [Sun Aug 29 14:28:44 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:48.964279 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b0773-f23a-4fe5-b458-70d1c4392863 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:48.964805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b0773-f23a-4fe5-b458-70d1c4392863 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:48.964883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b0773-f23a-4fe5-b458-70d1c4392863 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:48.966788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 627/1258] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:48.972862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6449ac-164d-4540-b9de-face1891a051 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:48.973298 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6449ac-164d-4540-b9de-face1891a051 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:48.973475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6449ac-164d-4540-b9de-face1891a051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:48.991342 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-5c6449ac-164d-4540-b9de-face1891a051 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:48.992801 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5c6449ac-164d-4540-b9de-face1891a051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:49.001173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 632/1259] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:49.053481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ce2fe-36dc-4d0c-a7fa-fd0982bed62c None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:49.054161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ce2fe-36dc-4d0c-a7fa-fd0982bed62c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:49.054589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ce2fe-36dc-4d0c-a7fa-fd0982bed62c None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:49.056646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 628/1260] 10.222.0.16 () {54 vars in 961 bytes} [Sun Aug 29 14:28:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:49.062699 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a70768-4ec2-4e5b-a938-16e3ac00fb21 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:49.063119 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a70768-4ec2-4e5b-a938-16e3ac00fb21 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:49.063472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a70768-4ec2-4e5b-a938-16e3ac00fb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:49.112489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-f7a70768-4ec2-4e5b-a938-16e3ac00fb21 None None] MFA Rules not processed for user `d8c0afa8f09f4923b9c8ab2696156129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:49.113678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f7a70768-4ec2-4e5b-a938-16e3ac00fb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:49.197157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 633/1261] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Aug 29 14:28:49 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:28:49.204138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ce2fe-36dc-4d0c-a7fa-fd0982bed62c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:49.218592 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ce2fe-36dc-4d0c-a7fa-fd0982bed62c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:49.223997 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6128d0-a7d6-477d-bdae-1243f4cff80c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:49.224727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6128d0-a7d6-477d-bdae-1243f4cff80c service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:49.225013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6128d0-a7d6-477d-bdae-1243f4cff80c service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:49.225808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6128d0-a7d6-477d-bdae-1243f4cff80c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:49.234066 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6128d0-a7d6-477d-bdae-1243f4cff80c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:49.235745 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6128d0-a7d6-477d-bdae-1243f4cff80c service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:49.245968 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 629/1262] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:51.646517 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67003a-2707-4976-a88a-756913bb8da8 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:51.647568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67003a-2707-4976-a88a-756913bb8da8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:51.647866 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67003a-2707-4976-a88a-756913bb8da8 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:51.649975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 634/1263] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:51.656739 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491935df-d802-4922-ad78-c42988a05aec None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:51.657275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491935df-d802-4922-ad78-c42988a05aec None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:51.657275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491935df-d802-4922-ad78-c42988a05aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:51.677181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-491935df-d802-4922-ad78-c42988a05aec None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:51.679009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-491935df-d802-4922-ad78-c42988a05aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:51.687363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 630/1264] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:51.734688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67003a-2707-4976-a88a-756913bb8da8 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:51.749817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67003a-2707-4976-a88a-756913bb8da8 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:51.755453 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f67df2-d140-43e1-9186-015105a4d4d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:51.756216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f67df2-d140-43e1-9186-015105a4d4d9 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:51.757314 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f67df2-d140-43e1-9186-015105a4d4d9 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:51.757596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f67df2-d140-43e1-9186-015105a4d4d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:51.765796 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f67df2-d140-43e1-9186-015105a4d4d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:51.767539 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f67df2-d140-43e1-9186-015105a4d4d9 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:51.777053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 635/1265] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:54.351109 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb791e01-8192-4132-bd52-9007fd512e41 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:54.351625 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb791e01-8192-4132-bd52-9007fd512e41 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:54.351625 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb791e01-8192-4132-bd52-9007fd512e41 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:54.353393 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 631/1266] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:54.359329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdbec6-ebe4-49fb-be4e-f20eaa9944eb None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:54.359716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdbec6-ebe4-49fb-be4e-f20eaa9944eb None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:54.359884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdbec6-ebe4-49fb-be4e-f20eaa9944eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:54.378178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-7abdbec6-ebe4-49fb-be4e-f20eaa9944eb None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:54.379347 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7abdbec6-ebe4-49fb-be4e-f20eaa9944eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:54.387464 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 636/1267] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:28:54.434256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f431e9-78ef-4117-a9ce-4f9a48d4c988 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:54.434622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f431e9-78ef-4117-a9ce-4f9a48d4c988 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:54.434970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f431e9-78ef-4117-a9ce-4f9a48d4c988 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:54.436843 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 632/1268] 10.222.0.16 () {54 vars in 961 bytes} [Sun Aug 29 14:28:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:54.442549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b02f6d-c4ba-4cd0-be14-68d7649fc71a None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:54.442836 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b02f6d-c4ba-4cd0-be14-68d7649fc71a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:54.443110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b02f6d-c4ba-4cd0-be14-68d7649fc71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:54.461201 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b7b02f6d-c4ba-4cd0-be14-68d7649fc71a None None] MFA Rules not processed for user `d8c0afa8f09f4923b9c8ab2696156129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:54.462401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b7b02f6d-c4ba-4cd0-be14-68d7649fc71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:54.478443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 637/1269] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Aug 29 14:28:54 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:54.486614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f431e9-78ef-4117-a9ce-4f9a48d4c988 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:54.501065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f431e9-78ef-4117-a9ce-4f9a48d4c988 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:54.506395 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8722c-bf23-467c-ae6c-c9eb243ce2b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:54.507064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8722c-bf23-467c-ae6c-c9eb243ce2b2 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:54.507339 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8722c-bf23-467c-ae6c-c9eb243ce2b2 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:54.507609 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8722c-bf23-467c-ae6c-c9eb243ce2b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:54.515406 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8722c-bf23-467c-ae6c-c9eb243ce2b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:54.516963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8722c-bf23-467c-ae6c-c9eb243ce2b2 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:54.526520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 633/1270] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:56.983663 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9780f10-9a27-4728-bfea-76bd6c7c77fa None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:56.984174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9780f10-9a27-4728-bfea-76bd6c7c77fa None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:56.984454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9780f10-9a27-4728-bfea-76bd6c7c77fa None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:56.986350 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 638/1271] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:28:56.992960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e2e19-8d54-43e5-9d4a-a71d777a0838 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:56.993364 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e2e19-8d54-43e5-9d4a-a71d777a0838 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:56.993511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e2e19-8d54-43e5-9d4a-a71d777a0838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:57.012674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-166e2e19-8d54-43e5-9d4a-a71d777a0838 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:57.013892 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-166e2e19-8d54-43e5-9d4a-a71d777a0838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:57.016082 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566eaba-6e84-4eaa-93f2-160a66caf8f4 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:57.016373 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566eaba-6e84-4eaa-93f2-160a66caf8f4 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:57.016652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566eaba-6e84-4eaa-93f2-160a66caf8f4 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:57.018454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 639/1272] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:28:57.030040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 634/1273] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:57.030167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da794d-a2da-474f-a8b2-b73e47127170 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:57.030167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da794d-a2da-474f-a8b2-b73e47127170 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:57.030167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da794d-a2da-474f-a8b2-b73e47127170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:57.046019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-39da794d-a2da-474f-a8b2-b73e47127170 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:57.047358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-39da794d-a2da-474f-a8b2-b73e47127170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:57.066172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 640/1274] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:28:57.071921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e2e19-8d54-43e5-9d4a-a71d777a0838 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:57.085690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e2e19-8d54-43e5-9d4a-a71d777a0838 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:57.092209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170aee5d-b936-48d8-ad93-9e4a56beba02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:57.093032 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170aee5d-b936-48d8-ad93-9e4a56beba02 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:57.093409 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170aee5d-b936-48d8-ad93-9e4a56beba02 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:57.093781 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170aee5d-b936-48d8-ad93-9e4a56beba02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:57.103525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170aee5d-b936-48d8-ad93-9e4a56beba02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:57.105262 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170aee5d-b936-48d8-ad93-9e4a56beba02 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:57.117541 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 635/1275] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:57.118545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42111d89-9e62-40ae-b508-8a142be986f3 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:57.119017 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42111d89-9e62-40ae-b508-8a142be986f3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:57.119392 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42111d89-9e62-40ae-b508-8a142be986f3 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:57.123837 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 641/1276] 10.222.0.16 () {54 vars in 966 bytes} [Sun Aug 29 14:28:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:57.127523 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62c844-ce13-498c-a168-a4c83470ae27 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:57.127816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62c844-ce13-498c-a168-a4c83470ae27 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:57.128094 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62c844-ce13-498c-a168-a4c83470ae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:57.174536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-be62c844-ce13-498c-a168-a4c83470ae27 None None] MFA Rules not processed for user `9ca81ff9c3114e8c9379418956063bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:57.175744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-be62c844-ce13-498c-a168-a4c83470ae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:57.241261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 636/1277] 10.222.0.16 () {58 vars in 1064 bytes} [Sun Aug 29 14:28:57 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:57.249288 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42111d89-9e62-40ae-b508-8a142be986f3 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:57.260078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42111d89-9e62-40ae-b508-8a142be986f3 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:57.264291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317212f9-9683-44ff-9483-f8fcaab12cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:57.265184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317212f9-9683-44ff-9483-f8fcaab12cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:57.265547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317212f9-9683-44ff-9483-f8fcaab12cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:57.265963 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317212f9-9683-44ff-9483-f8fcaab12cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:57.277983 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317212f9-9683-44ff-9483-f8fcaab12cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:57.279515 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317212f9-9683-44ff-9483-f8fcaab12cb8 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:57.292144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 642/1278] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:28:59.510227 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffb53a-a27e-4007-a139-050282314767 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:59.510734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffb53a-a27e-4007-a139-050282314767 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:59.510829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffb53a-a27e-4007-a139-050282314767 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:59.513139 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 637/1279] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:28:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:28:59.519162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e0fea-d4ea-4337-ba57-7c1e75bdbf52 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:59.519603 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e0fea-d4ea-4337-ba57-7c1e75bdbf52 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:59.519747 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e0fea-d4ea-4337-ba57-7c1e75bdbf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:59.543683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d61e0fea-d4ea-4337-ba57-7c1e75bdbf52 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:28:59.544939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d61e0fea-d4ea-4337-ba57-7c1e75bdbf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:28:59.552964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 643/1280] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:28:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:28:59.606867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffb53a-a27e-4007-a139-050282314767 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:28:59.631717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffb53a-a27e-4007-a139-050282314767 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:28:59.639120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009538d-a5ad-4222-acd4-81e3cd45c6c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:28:59.639953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009538d-a5ad-4222-acd4-81e3cd45c6c3 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:28:59.640389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009538d-a5ad-4222-acd4-81e3cd45c6c3 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:28:59.640830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009538d-a5ad-4222-acd4-81e3cd45c6c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:28:59.650437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009538d-a5ad-4222-acd4-81e3cd45c6c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:28:59.652020 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009538d-a5ad-4222-acd4-81e3cd45c6c3 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:28:59.661549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 638/1281] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:28:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:29:02.024065 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acee4c-6148-4213-9460-4705034c0b84 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:02.037857 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acee4c-6148-4213-9460-4705034c0b84 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:02.037857 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acee4c-6148-4213-9460-4705034c0b84 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:02.037857 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 644/1282] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:02.038159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c18e-550e-4d96-92a7-fc4bd7100dd0 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:02.038159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c18e-550e-4d96-92a7-fc4bd7100dd0 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:02.038159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c18e-550e-4d96-92a7-fc4bd7100dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:02.051605 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-b5a8c18e-550e-4d96-92a7-fc4bd7100dd0 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:02.055391 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b5a8c18e-550e-4d96-92a7-fc4bd7100dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:02.063327 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 639/1283] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:02.110139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acee4c-6148-4213-9460-4705034c0b84 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:02.126089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acee4c-6148-4213-9460-4705034c0b84 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:02.133314 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b327e-3dd6-451e-9ea3-88fd10b62b3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:02.134089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b327e-3dd6-451e-9ea3-88fd10b62b3b service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:02.134465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b327e-3dd6-451e-9ea3-88fd10b62b3b service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:02.134959 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b327e-3dd6-451e-9ea3-88fd10b62b3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:02.144626 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b327e-3dd6-451e-9ea3-88fd10b62b3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:02.147393 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b327e-3dd6-451e-9ea3-88fd10b62b3b service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:02.159564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 645/1284] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:29:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:29:04.501161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731362f-c3e0-4dad-93de-f27f31a8ac87 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:04.501161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731362f-c3e0-4dad-93de-f27f31a8ac87 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:04.502384 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731362f-c3e0-4dad-93de-f27f31a8ac87 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:04.508295 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 640/1285] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:04 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:04.509786 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad03245-e7fa-4d9c-aa52-6aa7115359ef None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:04.510488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad03245-e7fa-4d9c-aa52-6aa7115359ef None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:04.510488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad03245-e7fa-4d9c-aa52-6aa7115359ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:04.530238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3ad03245-e7fa-4d9c-aa52-6aa7115359ef None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:04.531720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3ad03245-e7fa-4d9c-aa52-6aa7115359ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:04.541580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 646/1286] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:04.586728 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731362f-c3e0-4dad-93de-f27f31a8ac87 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:04.603451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731362f-c3e0-4dad-93de-f27f31a8ac87 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:04.609113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee4171-69db-4a66-b6f4-811737214461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:04.609754 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee4171-69db-4a66-b6f4-811737214461 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:04.610807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee4171-69db-4a66-b6f4-811737214461 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:04.610807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee4171-69db-4a66-b6f4-811737214461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:04.619052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee4171-69db-4a66-b6f4-811737214461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:04.620973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee4171-69db-4a66-b6f4-811737214461 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:04.630551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 641/1287] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:29:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:29:06.836306 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee12d38-5602-4756-b3c8-5a226247bae7 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:06.836988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee12d38-5602-4756-b3c8-5a226247bae7 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:06.836988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee12d38-5602-4756-b3c8-5a226247bae7 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:06.838669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 647/1288] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:06.845428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a74a-3bb6-47e9-b565-8bfdd02d705c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:06.845842 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a74a-3bb6-47e9-b565-8bfdd02d705c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:06.846019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a74a-3bb6-47e9-b565-8bfdd02d705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:06.864753 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-5f18a74a-3bb6-47e9-b565-8bfdd02d705c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:06.866598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5f18a74a-3bb6-47e9-b565-8bfdd02d705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:06.874631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 642/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:06.921701 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee12d38-5602-4756-b3c8-5a226247bae7 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:06.940429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee12d38-5602-4756-b3c8-5a226247bae7 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:06.947359 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee508d-eebd-4457-a5f7-3969bbcbe8a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:06.948241 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee508d-eebd-4457-a5f7-3969bbcbe8a8 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:06.948771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee508d-eebd-4457-a5f7-3969bbcbe8a8 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:06.949133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee508d-eebd-4457-a5f7-3969bbcbe8a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:06.960153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee508d-eebd-4457-a5f7-3969bbcbe8a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:06.962528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee508d-eebd-4457-a5f7-3969bbcbe8a8 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:06.975475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 648/1290] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:29:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:29:09.393739 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178a93a-33ce-4ade-9240-524e8a3f8802 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:09.394298 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178a93a-33ce-4ade-9240-524e8a3f8802 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:09.394389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178a93a-33ce-4ade-9240-524e8a3f8802 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:09.396959 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 643/1291] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:09.403025 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a11a12-377e-43b9-a4f3-0562d81d4687 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:09.403512 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a11a12-377e-43b9-a4f3-0562d81d4687 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:09.403617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a11a12-377e-43b9-a4f3-0562d81d4687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:09.422205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-e8a11a12-377e-43b9-a4f3-0562d81d4687 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:09.427223 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e8a11a12-377e-43b9-a4f3-0562d81d4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:09.431652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 649/1292] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:09.480143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178a93a-33ce-4ade-9240-524e8a3f8802 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:09.498769 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178a93a-33ce-4ade-9240-524e8a3f8802 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:09.505294 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983fc70-5e5d-4d81-8080-510515532a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:09.506117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983fc70-5e5d-4d81-8080-510515532a86 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:09.506456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983fc70-5e5d-4d81-8080-510515532a86 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:09.506790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983fc70-5e5d-4d81-8080-510515532a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:09.516840 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983fc70-5e5d-4d81-8080-510515532a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:09.518919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983fc70-5e5d-4d81-8080-510515532a86 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:09.531272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 644/1293] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:29:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:29:11.928592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4106-0f79-489e-a88d-f0d766e7ad7d None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:11.929178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4106-0f79-489e-a88d-f0d766e7ad7d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:11.929178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4106-0f79-489e-a88d-f0d766e7ad7d None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:11.931182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 650/1294] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:11.937097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40768b04-62ee-4976-bd32-5bf9008a32fd None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:11.937527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40768b04-62ee-4976-bd32-5bf9008a32fd None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:11.937637 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40768b04-62ee-4976-bd32-5bf9008a32fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:11.954923 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-40768b04-62ee-4976-bd32-5bf9008a32fd None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:11.956112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-40768b04-62ee-4976-bd32-5bf9008a32fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:11.964863 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 645/1295] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:12.012683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e4106-0f79-489e-a88d-f0d766e7ad7d None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:12.027295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e4106-0f79-489e-a88d-f0d766e7ad7d None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:12.032595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59dd4ec-8f5a-4af2-bd0e-111720babb89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:12.033227 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dd4ec-8f5a-4af2-bd0e-111720babb89 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:12.033770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dd4ec-8f5a-4af2-bd0e-111720babb89 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:12.033770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dd4ec-8f5a-4af2-bd0e-111720babb89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:12.042507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59dd4ec-8f5a-4af2-bd0e-111720babb89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:12.044164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59dd4ec-8f5a-4af2-bd0e-111720babb89 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:12.053357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 651/1296] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:29:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:29:12.346656 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974bfcb-46e6-4704-a2dd-b6a68c7eb16c None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:12.346939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974bfcb-46e6-4704-a2dd-b6a68c7eb16c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:12.347225 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974bfcb-46e6-4704-a2dd-b6a68c7eb16c None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:12.349423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 646/1297] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:12.356275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462e0cf-22bc-4658-99b1-dc301ad9d5ee None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:12.356568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462e0cf-22bc-4658-99b1-dc301ad9d5ee None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:12.356874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462e0cf-22bc-4658-99b1-dc301ad9d5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:12.375878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3462e0cf-22bc-4658-99b1-dc301ad9d5ee None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:12.377090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3462e0cf-22bc-4658-99b1-dc301ad9d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:12.386082 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 652/1298] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:12.446950 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89005d41-c813-400f-ac9e-2eb88dccce51 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:12.447246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89005d41-c813-400f-ac9e-2eb88dccce51 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:12.447510 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89005d41-c813-400f-ac9e-2eb88dccce51 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:12.449244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 647/1299] 10.222.0.16 () {54 vars in 966 bytes} [Sun Aug 29 14:29:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:12.454638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a1280-d3ac-4dca-8ae4-4493a1ae8fd4 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:12.454928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a1280-d3ac-4dca-8ae4-4493a1ae8fd4 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:12.455204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a1280-d3ac-4dca-8ae4-4493a1ae8fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:12.503358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-1f2a1280-d3ac-4dca-8ae4-4493a1ae8fd4 None None] MFA Rules not processed for user `db83070471e34df695b571cdab440b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:12.504564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1f2a1280-d3ac-4dca-8ae4-4493a1ae8fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:12.562541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 653/1300] 10.222.0.16 () {58 vars in 1064 bytes} [Sun Aug 29 14:29:12 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:29:12.570714 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89005d41-c813-400f-ac9e-2eb88dccce51 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:12.580939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89005d41-c813-400f-ac9e-2eb88dccce51 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:12.584415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1b9a7-74f1-426f-a17e-f1cee7c27d8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db83070471e34df695b571cdab440b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:12.585033 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1b9a7-74f1-426f-a17e-f1cee7c27d8d service glance] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:12.585307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1b9a7-74f1-426f-a17e-f1cee7c27d8d service glance] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:12.585577 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1b9a7-74f1-426f-a17e-f1cee7c27d8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:12.594969 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1b9a7-74f1-426f-a17e-f1cee7c27d8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:12.596385 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1b9a7-74f1-426f-a17e-f1cee7c27d8d service glance] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:12.605576 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 648/1301] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:29:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:29:13.202105 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadce76-0ae5-4e7f-80e1-fa6bf45c8a05 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:13.202572 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadce76-0ae5-4e7f-80e1-fa6bf45c8a05 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:13.202659 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadce76-0ae5-4e7f-80e1-fa6bf45c8a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:13.249987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-5fadce76-0ae5-4e7f-80e1-fa6bf45c8a05 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:13.251181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5fadce76-0ae5-4e7f-80e1-fa6bf45c8a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:13.312883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 654/1302] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:29:13 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:13.356141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd2cd8-eddd-4326-9fbb-2ec6aee436e3 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:13.356646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd2cd8-eddd-4326-9fbb-2ec6aee436e3 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:13.356742 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd2cd8-eddd-4326-9fbb-2ec6aee436e3 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:13.358461 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 649/1303] 10.222.0.16 () {54 vars in 942 bytes} [Sun Aug 29 14:29:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:13.366003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f0a26-e64f-4998-936c-2e8e82ad9b0e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:13.366299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f0a26-e64f-4998-936c-2e8e82ad9b0e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:13.366579 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f0a26-e64f-4998-936c-2e8e82ad9b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:13.414734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-4b9f0a26-e64f-4998-936c-2e8e82ad9b0e None None] MFA Rules not processed for user `f37041a9727e4ab6a5c52b00327e7a19`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:13.415928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4b9f0a26-e64f-4998-936c-2e8e82ad9b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:13.485568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 655/1304] 10.222.0.16 () {58 vars in 1040 bytes} [Sun Aug 29 14:29:13 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:13.496065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd2cd8-eddd-4326-9fbb-2ec6aee436e3 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:13.509735 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd2cd8-eddd-4326-9fbb-2ec6aee436e3 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:13.514661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b51f4-5fcb-461a-8e34-8f7fc8567f27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:13.515293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b51f4-5fcb-461a-8e34-8f7fc8567f27 service swift] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:13.515568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b51f4-5fcb-461a-8e34-8f7fc8567f27 service swift] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:13.515838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b51f4-5fcb-461a-8e34-8f7fc8567f27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:13.523993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b51f4-5fcb-461a-8e34-8f7fc8567f27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:13.525547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b51f4-5fcb-461a-8e34-8f7fc8567f27 service swift] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:13.533203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 650/1305] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:29:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 14:29:14.367703 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f44bb-31b8-44ad-8d44-1efa67144aa4 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:14.368273 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f44bb-31b8-44ad-8d44-1efa67144aa4 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:14.368273 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f44bb-31b8-44ad-8d44-1efa67144aa4 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:14.370615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 656/1306] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:14.376609 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9371893-23db-4e5b-bfd2-492a8b01acd6 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:14.377182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9371893-23db-4e5b-bfd2-492a8b01acd6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:14.377182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9371893-23db-4e5b-bfd2-492a8b01acd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:14.395338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c9371893-23db-4e5b-bfd2-492a8b01acd6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:14.397370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c9371893-23db-4e5b-bfd2-492a8b01acd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:14.405419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 651/1307] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:14.451878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f44bb-31b8-44ad-8d44-1efa67144aa4 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:14.466666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f44bb-31b8-44ad-8d44-1efa67144aa4 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:14.473736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2aaf5b-9a0b-465d-9ed0-9a9f438505bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:14.474549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2aaf5b-9a0b-465d-9ed0-9a9f438505bb service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:14.474835 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2aaf5b-9a0b-465d-9ed0-9a9f438505bb service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:14.475117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2aaf5b-9a0b-465d-9ed0-9a9f438505bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:14.483939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2aaf5b-9a0b-465d-9ed0-9a9f438505bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:14.485531 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2aaf5b-9a0b-465d-9ed0-9a9f438505bb service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:14.496457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 657/1308] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:29:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:29:16.907365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3738d5-ad87-42a6-8d9c-a00e9188123c None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:16.908001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3738d5-ad87-42a6-8d9c-a00e9188123c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:16.908001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3738d5-ad87-42a6-8d9c-a00e9188123c None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:16.914368 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 652/1309] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:16 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:16.916345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54a89d-a15a-4f04-b1e2-be0b6e0d191d None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:16.916783 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54a89d-a15a-4f04-b1e2-be0b6e0d191d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:16.916929 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54a89d-a15a-4f04-b1e2-be0b6e0d191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:16.940037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-9b54a89d-a15a-4f04-b1e2-be0b6e0d191d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:16.941375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-9b54a89d-a15a-4f04-b1e2-be0b6e0d191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:16.949746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 658/1310] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:29:17.003868 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3738d5-ad87-42a6-8d9c-a00e9188123c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:17.018548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3738d5-ad87-42a6-8d9c-a00e9188123c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:17.030635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891decb3-5dfd-4872-aa84-f3c78e54ffaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:17.030635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891decb3-5dfd-4872-aa84-f3c78e54ffaa service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:17.030635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891decb3-5dfd-4872-aa84-f3c78e54ffaa service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:17.030635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891decb3-5dfd-4872-aa84-f3c78e54ffaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:17.036906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891decb3-5dfd-4872-aa84-f3c78e54ffaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:17.036906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891decb3-5dfd-4872-aa84-f3c78e54ffaa service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:17.048274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 653/1311] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:29:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:29:32.162258 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7337b6-54a9-478d-b5ee-2dfacf108b16 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:32.162805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7337b6-54a9-478d-b5ee-2dfacf108b16 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:32.162805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7337b6-54a9-478d-b5ee-2dfacf108b16 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:32.164567 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 659/1312] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:32.170429 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cce09-8187-42e7-8347-dfaa7b9a5dfa None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:32.170870 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cce09-8187-42e7-8347-dfaa7b9a5dfa None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:32.170966 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cce09-8187-42e7-8347-dfaa7b9a5dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:32.188657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-086cce09-8187-42e7-8347-dfaa7b9a5dfa None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:32.189829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-086cce09-8187-42e7-8347-dfaa7b9a5dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:32.197747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 654/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:29:32.222165 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7337b6-54a9-478d-b5ee-2dfacf108b16 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:32.234731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7337b6-54a9-478d-b5ee-2dfacf108b16 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:32.240099 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a7970-3ab0-4468-ba6c-2b040eeedfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:32.240730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7970-3ab0-4468-ba6c-2b040eeedfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:32.241007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7970-3ab0-4468-ba6c-2b040eeedfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:32.241280 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7970-3ab0-4468-ba6c-2b040eeedfd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:32.242026 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a7970-3ab0-4468-ba6c-2b040eeedfd1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:32.244115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a7970-3ab0-4468-ba6c-2b040eeedfd1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:32.257255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 660/1314] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Aug 29 14:29:32 2021] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:29:34.354992 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c865259-460e-419c-be94-0a33aa2b50fd None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:34.355549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c865259-460e-419c-be94-0a33aa2b50fd None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:34.355549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c865259-460e-419c-be94-0a33aa2b50fd None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:34.357264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 655/1315] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:34.363208 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675a554-af7a-4ff0-8e15-f18b5783a6fd None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:34.363673 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675a554-af7a-4ff0-8e15-f18b5783a6fd None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:34.363860 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675a554-af7a-4ff0-8e15-f18b5783a6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:34.381623 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b675a554-af7a-4ff0-8e15-f18b5783a6fd None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:34.382829 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b675a554-af7a-4ff0-8e15-f18b5783a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:34.390401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 661/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:34.415101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c865259-460e-419c-be94-0a33aa2b50fd None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:34.427980 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c865259-460e-419c-be94-0a33aa2b50fd None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:34.432418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d7346-08f3-495f-8126-c9784a977802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:34.433244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d7346-08f3-495f-8126-c9784a977802 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:34.433514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d7346-08f3-495f-8126-c9784a977802 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:34.433773 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d7346-08f3-495f-8126-c9784a977802 admin admin] PATH_INFO: `/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:34.443974 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d7346-08f3-495f-8126-c9784a977802 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a54648acdde4ad6bf01c13ca38c04a8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:34.446037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d7346-08f3-495f-8126-c9784a977802 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:34.447661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 656/1317] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:29:34 2021] GET /identity/v3/projects/0a54648acdde4ad6bf01c13ca38c04a8 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:34.454061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675a554-af7a-4ff0-8e15-f18b5783a6fd None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:34.462848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675a554-af7a-4ff0-8e15-f18b5783a6fd None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:34.467322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a8ff8-906d-48a5-aca0-0eda4a6b64a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:34.467970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a8ff8-906d-48a5-aca0-0eda4a6b64a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:34.468244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a8ff8-906d-48a5-aca0-0eda4a6b64a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:34.468511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a8ff8-906d-48a5-aca0-0eda4a6b64a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:34.469256 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a8ff8-906d-48a5-aca0-0eda4a6b64a4 admin admin] RBAC: Adding query filter params (scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:29:34.469555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a8ff8-906d-48a5-aca0-0eda4a6b64a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:34.471398 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a8ff8-906d-48a5-aca0-0eda4a6b64a4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:34.479405 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 662/1318] 10.222.0.16 () {56 vars in 1232 bytes} [Sun Aug 29 14:29:34 2021] GET /identity/v3/role_assignments?scope.project.id=0a54648acdde4ad6bf01c13ca38c04a8 => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:29:34.485614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d7346-08f3-495f-8126-c9784a977802 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:34.495897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d7346-08f3-495f-8126-c9784a977802 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:34.500402 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48975a-ecff-4811-8b06-bee813ae53b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:34.501237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48975a-ecff-4811-8b06-bee813ae53b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:34.501515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48975a-ecff-4811-8b06-bee813ae53b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:34.501786 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48975a-ecff-4811-8b06-bee813ae53b1 admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:34.502976 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf48975a-ecff-4811-8b06-bee813ae53b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:34.504718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf48975a-ecff-4811-8b06-bee813ae53b1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:34.506291 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 657/1319] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:29:34 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:34.512111 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a8ff8-906d-48a5-aca0-0eda4a6b64a4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:34.521525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a8ff8-906d-48a5-aca0-0eda4a6b64a4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:34.525989 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3ab6a-5b90-455c-bb95-f07109b69651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:34.526839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3ab6a-5b90-455c-bb95-f07109b69651 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:34.527100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3ab6a-5b90-455c-bb95-f07109b69651 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:34.527368 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3ab6a-5b90-455c-bb95-f07109b69651 admin admin] PATH_INFO: `/v3/users/7b3af60575154adca1fde17caac19ae8` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:34.540583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3ab6a-5b90-455c-bb95-f07109b69651 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b3af60575154adca1fde17caac19ae8)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:34.542725 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3ab6a-5b90-455c-bb95-f07109b69651 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:34.544301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 663/1320] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:29:34 2021] GET /identity/v3/users/7b3af60575154adca1fde17caac19ae8 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:36.771237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e852a6-366c-452a-987f-4aafe2b78b80 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:36.771774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e852a6-366c-452a-987f-4aafe2b78b80 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:36.771774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e852a6-366c-452a-987f-4aafe2b78b80 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:36.773526 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 658/1321] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:36.779623 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01489a1-5b37-4d33-9e4e-f9d32c513af6 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:36.780048 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01489a1-5b37-4d33-9e4e-f9d32c513af6 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:36.780187 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01489a1-5b37-4d33-9e4e-f9d32c513af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:36.798118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-f01489a1-5b37-4d33-9e4e-f9d32c513af6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:36.799304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f01489a1-5b37-4d33-9e4e-f9d32c513af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:36.807053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 664/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:36.836330 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e852a6-366c-452a-987f-4aafe2b78b80 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:36.850094 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e852a6-366c-452a-987f-4aafe2b78b80 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:36.854782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81401485-fc5b-40c2-98fc-10982a335781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:36.855622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81401485-fc5b-40c2-98fc-10982a335781 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:36.855925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81401485-fc5b-40c2-98fc-10982a335781 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:36.856192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81401485-fc5b-40c2-98fc-10982a335781 admin admin] PATH_INFO: `/v3/projects/15b1360b3e054515826a5afbbea45320` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:36.867005 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81401485-fc5b-40c2-98fc-10982a335781 admin admin] RBAC: Authorizing `identity:get_project(project_id=15b1360b3e054515826a5afbbea45320)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:36.869292 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81401485-fc5b-40c2-98fc-10982a335781 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:36.870970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 659/1323] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:29:36 2021] GET /identity/v3/projects/15b1360b3e054515826a5afbbea45320 => generated 361 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:36.877593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01489a1-5b37-4d33-9e4e-f9d32c513af6 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:36.887221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01489a1-5b37-4d33-9e4e-f9d32c513af6 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:36.891664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47120165-1e8d-476a-b037-10a6bef97cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:36.892295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47120165-1e8d-476a-b037-10a6bef97cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:36.892571 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47120165-1e8d-476a-b037-10a6bef97cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:36.892838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47120165-1e8d-476a-b037-10a6bef97cf6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:36.893589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47120165-1e8d-476a-b037-10a6bef97cf6 admin admin] RBAC: Adding query filter params (scope.project.id=15b1360b3e054515826a5afbbea45320) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:29:36.893913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47120165-1e8d-476a-b037-10a6bef97cf6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:36.896397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47120165-1e8d-476a-b037-10a6bef97cf6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:36.901617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 665/1324] 10.222.0.16 () {56 vars in 1232 bytes} [Sun Aug 29 14:29:36 2021] GET /identity/v3/role_assignments?scope.project.id=15b1360b3e054515826a5afbbea45320 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:36.907869 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81401485-fc5b-40c2-98fc-10982a335781 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:36.917388 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81401485-fc5b-40c2-98fc-10982a335781 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:36.922045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d642f9-fbef-4ac1-8662-253790198992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:36.922926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d642f9-fbef-4ac1-8662-253790198992 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:36.923204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d642f9-fbef-4ac1-8662-253790198992 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:36.923478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d642f9-fbef-4ac1-8662-253790198992 admin admin] PATH_INFO: `/v3/users/6e5230c9e9174e9eb4a8f66c362efbb5` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:36.937240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d642f9-fbef-4ac1-8662-253790198992 admin admin] RBAC: Authorizing `identity:get_user(user_id=6e5230c9e9174e9eb4a8f66c362efbb5)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:36.939410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d642f9-fbef-4ac1-8662-253790198992 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:36.941041 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 660/1325] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:29:36 2021] GET /identity/v3/users/6e5230c9e9174e9eb4a8f66c362efbb5 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:39.102837 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6661ee-84ca-42c5-b096-ac3a6461730e None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:39.103355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6661ee-84ca-42c5-b096-ac3a6461730e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:39.103443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6661ee-84ca-42c5-b096-ac3a6461730e None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:39.105170 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 666/1326] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:39.110920 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c341f-4a09-4247-8930-1ca531a73c2a None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:39.111337 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c341f-4a09-4247-8930-1ca531a73c2a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:39.111477 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c341f-4a09-4247-8930-1ca531a73c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:39.129423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-988c341f-4a09-4247-8930-1ca531a73c2a None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:39.130644 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-988c341f-4a09-4247-8930-1ca531a73c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:39.138165 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 661/1327] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:39.162316 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6661ee-84ca-42c5-b096-ac3a6461730e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:39.174544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6661ee-84ca-42c5-b096-ac3a6461730e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:39.179640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedb922-7138-44ca-8b3d-2456fa2ec603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:39.180460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedb922-7138-44ca-8b3d-2456fa2ec603 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:39.180734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedb922-7138-44ca-8b3d-2456fa2ec603 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:39.181002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedb922-7138-44ca-8b3d-2456fa2ec603 admin admin] PATH_INFO: `/v3/projects/3ee3fdc9b9a0424b897a4f05d6b3569f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:39.182172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedb922-7138-44ca-8b3d-2456fa2ec603 admin admin] RBAC: Authorizing `identity:get_project(project_id=3ee3fdc9b9a0424b897a4f05d6b3569f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:39.183930 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedb922-7138-44ca-8b3d-2456fa2ec603 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:39.185549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 667/1328] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:29:39 2021] GET /identity/v3/projects/3ee3fdc9b9a0424b897a4f05d6b3569f => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:29:39.192078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c341f-4a09-4247-8930-1ca531a73c2a None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:39.200865 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c341f-4a09-4247-8930-1ca531a73c2a None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:39.205308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249fc2d-37c0-4a30-bcf3-b1f8bf4f68fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:39.206020 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249fc2d-37c0-4a30-bcf3-b1f8bf4f68fb admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:39.206256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249fc2d-37c0-4a30-bcf3-b1f8bf4f68fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:39.206530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249fc2d-37c0-4a30-bcf3-b1f8bf4f68fb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:39.207962 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249fc2d-37c0-4a30-bcf3-b1f8bf4f68fb admin admin] RBAC: Adding query filter params (scope.project.id=3ee3fdc9b9a0424b897a4f05d6b3569f) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:29:39.208272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249fc2d-37c0-4a30-bcf3-b1f8bf4f68fb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:39.210112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249fc2d-37c0-4a30-bcf3-b1f8bf4f68fb admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:39.216584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 662/1329] 10.222.0.16 () {56 vars in 1232 bytes} [Sun Aug 29 14:29:39 2021] GET /identity/v3/role_assignments?scope.project.id=3ee3fdc9b9a0424b897a4f05d6b3569f => generated 879 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:39.223362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedb922-7138-44ca-8b3d-2456fa2ec603 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:39.233102 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedb922-7138-44ca-8b3d-2456fa2ec603 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:39.237652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f10205-8412-4a1b-8b0a-f132e5265a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:39.238945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f10205-8412-4a1b-8b0a-f132e5265a45 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:39.239229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f10205-8412-4a1b-8b0a-f132e5265a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:39.239504 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f10205-8412-4a1b-8b0a-f132e5265a45 admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:39.240747 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f10205-8412-4a1b-8b0a-f132e5265a45 admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:39.242602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f10205-8412-4a1b-8b0a-f132e5265a45 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:39.244429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 668/1330] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:29:39 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:29:41.411184 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd456c1-2589-4173-b6fe-78871fafeb8f None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:41.411740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd456c1-2589-4173-b6fe-78871fafeb8f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:41.411740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd456c1-2589-4173-b6fe-78871fafeb8f None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:41.413472 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 663/1331] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:41.419316 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8369192-d0db-4fd3-b6e8-25a847299577 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:41.419746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8369192-d0db-4fd3-b6e8-25a847299577 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:41.419978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8369192-d0db-4fd3-b6e8-25a847299577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:41.437721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-a8369192-d0db-4fd3-b6e8-25a847299577 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:41.438923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a8369192-d0db-4fd3-b6e8-25a847299577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:41.447224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 669/1332] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:29:41.471118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd456c1-2589-4173-b6fe-78871fafeb8f None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:41.483191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd456c1-2589-4173-b6fe-78871fafeb8f None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:41.487583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f4fe9-dc87-4534-97d2-5b86cc42fa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:41.488414 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f4fe9-dc87-4534-97d2-5b86cc42fa9a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:41.489180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f4fe9-dc87-4534-97d2-5b86cc42fa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:41.489553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f4fe9-dc87-4534-97d2-5b86cc42fa9a admin admin] PATH_INFO: `/v3/projects/5f868635149a44f4a2b5cb7811d17563` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:41.500521 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f4fe9-dc87-4534-97d2-5b86cc42fa9a admin admin] RBAC: Authorizing `identity:get_project(project_id=5f868635149a44f4a2b5cb7811d17563)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:41.502592 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f4fe9-dc87-4534-97d2-5b86cc42fa9a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:41.504249 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 664/1333] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:29:41 2021] GET /identity/v3/projects/5f868635149a44f4a2b5cb7811d17563 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:41.511241 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8369192-d0db-4fd3-b6e8-25a847299577 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:41.520041 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8369192-d0db-4fd3-b6e8-25a847299577 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:41.524661 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5771971-7a6c-45fa-8381-fbbe51c6375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:41.525290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5771971-7a6c-45fa-8381-fbbe51c6375e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:41.525566 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5771971-7a6c-45fa-8381-fbbe51c6375e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:41.525838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5771971-7a6c-45fa-8381-fbbe51c6375e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:41.526616 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5771971-7a6c-45fa-8381-fbbe51c6375e admin admin] RBAC: Adding query filter params (scope.project.id=5f868635149a44f4a2b5cb7811d17563) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:29:41.526917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5771971-7a6c-45fa-8381-fbbe51c6375e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:41.528807 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5771971-7a6c-45fa-8381-fbbe51c6375e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:41.535225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 670/1334] 10.222.0.16 () {56 vars in 1232 bytes} [Sun Aug 29 14:29:41 2021] GET /identity/v3/role_assignments?scope.project.id=5f868635149a44f4a2b5cb7811d17563 => generated 1934 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:29:41.541309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f4fe9-dc87-4534-97d2-5b86cc42fa9a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:41.550675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f4fe9-dc87-4534-97d2-5b86cc42fa9a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:41.555865 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a14d5-546f-4c47-a510-094c4135f6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:41.556706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a14d5-546f-4c47-a510-094c4135f6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:41.556985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a14d5-546f-4c47-a510-094c4135f6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:41.557256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a14d5-546f-4c47-a510-094c4135f6b8 admin admin] PATH_INFO: `/v3/users/a0f8f7fa57374efdb2df20708faea2ef` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:41.558436 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a14d5-546f-4c47-a510-094c4135f6b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f8f7fa57374efdb2df20708faea2ef)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:41.560187 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a14d5-546f-4c47-a510-094c4135f6b8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:41.561725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 665/1335] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:29:41 2021] GET /identity/v3/users/a0f8f7fa57374efdb2df20708faea2ef => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:41.568136 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5771971-7a6c-45fa-8381-fbbe51c6375e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:41.577353 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5771971-7a6c-45fa-8381-fbbe51c6375e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:41.581809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fb472-6e66-4a03-ae7d-9cb195f32556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:41.582680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fb472-6e66-4a03-ae7d-9cb195f32556 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:41.583034 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fb472-6e66-4a03-ae7d-9cb195f32556 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:41.583221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fb472-6e66-4a03-ae7d-9cb195f32556 admin admin] PATH_INFO: `/v3/users/7c84bf7add6545f0b6f8356748e2bb9f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:41.596425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fb472-6e66-4a03-ae7d-9cb195f32556 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c84bf7add6545f0b6f8356748e2bb9f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:41.598550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fb472-6e66-4a03-ae7d-9cb195f32556 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:41.600121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 671/1336] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:29:41 2021] GET /identity/v3/users/7c84bf7add6545f0b6f8356748e2bb9f => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:43.815772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeef8eb-9ed0-489e-ab92-a97dcbec1853 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:43.816362 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeef8eb-9ed0-489e-ab92-a97dcbec1853 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:43.816362 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeef8eb-9ed0-489e-ab92-a97dcbec1853 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:43.818145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 666/1337] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:43.824092 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03f59e-2952-41ce-ae94-8382ca58568e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:43.824510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03f59e-2952-41ce-ae94-8382ca58568e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:43.824645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03f59e-2952-41ce-ae94-8382ca58568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:43.842499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-1b03f59e-2952-41ce-ae94-8382ca58568e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:43.843694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1b03f59e-2952-41ce-ae94-8382ca58568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:43.852315 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 672/1338] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:43.876586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeef8eb-9ed0-489e-ab92-a97dcbec1853 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:43.888733 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeef8eb-9ed0-489e-ab92-a97dcbec1853 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:43.893252 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776cab8-c110-469c-a718-9f29f602c03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:43.894119 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776cab8-c110-469c-a718-9f29f602c03e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:43.894400 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776cab8-c110-469c-a718-9f29f602c03e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:43.894673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776cab8-c110-469c-a718-9f29f602c03e admin admin] PATH_INFO: `/v3/projects/6c97ccf13c44446abf43db9c4897c198` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:43.905384 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776cab8-c110-469c-a718-9f29f602c03e admin admin] RBAC: Authorizing `identity:get_project(project_id=6c97ccf13c44446abf43db9c4897c198)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:43.907440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776cab8-c110-469c-a718-9f29f602c03e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:43.909075 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 667/1339] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:29:43 2021] GET /identity/v3/projects/6c97ccf13c44446abf43db9c4897c198 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:43.916808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03f59e-2952-41ce-ae94-8382ca58568e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:43.925677 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03f59e-2952-41ce-ae94-8382ca58568e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:43.931290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b805d-2704-411e-94ee-896914469ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:43.931944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b805d-2704-411e-94ee-896914469ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:43.932220 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b805d-2704-411e-94ee-896914469ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:43.932488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b805d-2704-411e-94ee-896914469ef9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:43.933282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b805d-2704-411e-94ee-896914469ef9 admin admin] RBAC: Adding query filter params (scope.project.id=6c97ccf13c44446abf43db9c4897c198) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:29:43.933583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b805d-2704-411e-94ee-896914469ef9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:43.935482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b805d-2704-411e-94ee-896914469ef9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:43.941352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 673/1340] 10.222.0.16 () {56 vars in 1232 bytes} [Sun Aug 29 14:29:43 2021] GET /identity/v3/role_assignments?scope.project.id=6c97ccf13c44446abf43db9c4897c198 => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:29:43.948146 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776cab8-c110-469c-a718-9f29f602c03e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:43.957839 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776cab8-c110-469c-a718-9f29f602c03e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:43.962551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9fbdb-a16e-4a80-a2ac-36de7d87b36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:43.963412 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9fbdb-a16e-4a80-a2ac-36de7d87b36c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:43.963690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9fbdb-a16e-4a80-a2ac-36de7d87b36c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:43.963964 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9fbdb-a16e-4a80-a2ac-36de7d87b36c admin admin] PATH_INFO: `/v3/users/4c105306e49c4a0aba28a4df9939ff8a` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:43.977423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9fbdb-a16e-4a80-a2ac-36de7d87b36c admin admin] RBAC: Authorizing `identity:get_user(user_id=4c105306e49c4a0aba28a4df9939ff8a)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:43.979567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9fbdb-a16e-4a80-a2ac-36de7d87b36c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:43.981179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 668/1341] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:29:43 2021] GET /identity/v3/users/4c105306e49c4a0aba28a4df9939ff8a => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:43.987635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b805d-2704-411e-94ee-896914469ef9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:43.998235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b805d-2704-411e-94ee-896914469ef9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:44.002798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6fa6b-7c2e-4e83-ad2d-9378ae72a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:44.003644 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6fa6b-7c2e-4e83-ad2d-9378ae72a04d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:44.003927 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6fa6b-7c2e-4e83-ad2d-9378ae72a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:44.004205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6fa6b-7c2e-4e83-ad2d-9378ae72a04d admin admin] PATH_INFO: `/v3/users/072d7266e7384af58901ab6b4ac20dbf` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:44.018380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6fa6b-7c2e-4e83-ad2d-9378ae72a04d admin admin] RBAC: Authorizing `identity:get_user(user_id=072d7266e7384af58901ab6b4ac20dbf)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:44.020678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6fa6b-7c2e-4e83-ad2d-9378ae72a04d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:44.025072 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 674/1342] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:29:43 2021] GET /identity/v3/users/072d7266e7384af58901ab6b4ac20dbf => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:46.276295 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb07d22-58af-43ca-8383-08b71fce5949 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:46.276827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb07d22-58af-43ca-8383-08b71fce5949 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:46.276944 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb07d22-58af-43ca-8383-08b71fce5949 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:46.278711 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 669/1343] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:46.284576 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba90c6a-3116-4a6d-8de4-e1577eaf20aa None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:46.285007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba90c6a-3116-4a6d-8de4-e1577eaf20aa None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:46.285189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba90c6a-3116-4a6d-8de4-e1577eaf20aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:46.302956 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-2ba90c6a-3116-4a6d-8de4-e1577eaf20aa None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:46.304155 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2ba90c6a-3116-4a6d-8de4-e1577eaf20aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:46.311925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 675/1344] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:46.336858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb07d22-58af-43ca-8383-08b71fce5949 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:46.349475 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb07d22-58af-43ca-8383-08b71fce5949 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:46.353922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d4132-f3b1-4b4d-89bd-4802d6c92eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:46.354761 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d4132-f3b1-4b4d-89bd-4802d6c92eaa admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:46.355044 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d4132-f3b1-4b4d-89bd-4802d6c92eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:46.355318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d4132-f3b1-4b4d-89bd-4802d6c92eaa admin admin] PATH_INFO: `/v3/projects/b96566913c3d4ce3b681e68bbcb26824` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:46.365962 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d4132-f3b1-4b4d-89bd-4802d6c92eaa admin admin] RBAC: Authorizing `identity:get_project(project_id=b96566913c3d4ce3b681e68bbcb26824)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:46.368263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d4132-f3b1-4b4d-89bd-4802d6c92eaa admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:46.369941 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 670/1345] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:29:46 2021] GET /identity/v3/projects/b96566913c3d4ce3b681e68bbcb26824 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:46.376333 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba90c6a-3116-4a6d-8de4-e1577eaf20aa None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:46.385847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba90c6a-3116-4a6d-8de4-e1577eaf20aa None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:46.390433 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53e477-30f4-4940-9914-6285c2ccc0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:46.391075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53e477-30f4-4940-9914-6285c2ccc0af admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:46.391357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53e477-30f4-4940-9914-6285c2ccc0af admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:46.391638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53e477-30f4-4940-9914-6285c2ccc0af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:46.392397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53e477-30f4-4940-9914-6285c2ccc0af admin admin] RBAC: Adding query filter params (scope.project.id=b96566913c3d4ce3b681e68bbcb26824) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:29:46.392705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53e477-30f4-4940-9914-6285c2ccc0af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:46.394561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53e477-30f4-4940-9914-6285c2ccc0af admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:46.400532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 676/1346] 10.222.0.16 () {56 vars in 1232 bytes} [Sun Aug 29 14:29:46 2021] GET /identity/v3/role_assignments?scope.project.id=b96566913c3d4ce3b681e68bbcb26824 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:46.412967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d4132-f3b1-4b4d-89bd-4802d6c92eaa admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:46.423897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d4132-f3b1-4b4d-89bd-4802d6c92eaa admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:46.428592 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389ca5e-bb65-45df-b7fb-f34c75048a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:46.429442 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389ca5e-bb65-45df-b7fb-f34c75048a59 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:46.429723 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389ca5e-bb65-45df-b7fb-f34c75048a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:46.430038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389ca5e-bb65-45df-b7fb-f34c75048a59 admin admin] PATH_INFO: `/v3/users/c56a49935940457d8fb6fa79a556c97b` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:46.443729 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389ca5e-bb65-45df-b7fb-f34c75048a59 admin admin] RBAC: Authorizing `identity:get_user(user_id=c56a49935940457d8fb6fa79a556c97b)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:46.445880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389ca5e-bb65-45df-b7fb-f34c75048a59 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:46.447508 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 671/1347] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:29:46 2021] GET /identity/v3/users/c56a49935940457d8fb6fa79a556c97b => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:48.605843 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c1f23-74d9-434d-b148-fc609b4b3dc1 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:48.606460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c1f23-74d9-434d-b148-fc609b4b3dc1 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:48.606460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c1f23-74d9-434d-b148-fc609b4b3dc1 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:48.608198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 677/1348] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:48.614357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506e472-00b1-4160-ac93-53418074915f None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:48.614796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506e472-00b1-4160-ac93-53418074915f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:48.614897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506e472-00b1-4160-ac93-53418074915f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:48.632724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f506e472-00b1-4160-ac93-53418074915f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:48.633930 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f506e472-00b1-4160-ac93-53418074915f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:48.641430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 672/1349] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:48.666261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c1f23-74d9-434d-b148-fc609b4b3dc1 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:48.678323 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c1f23-74d9-434d-b148-fc609b4b3dc1 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:48.682714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055e499-4885-4273-a34b-5594021ae483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:48.683539 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055e499-4885-4273-a34b-5594021ae483 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:48.683820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055e499-4885-4273-a34b-5594021ae483 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:48.684092 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055e499-4885-4273-a34b-5594021ae483 admin admin] PATH_INFO: `/v3/projects/ccbc591f84f8431abfe14b7bddd59ecf` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:48.695262 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055e499-4885-4273-a34b-5594021ae483 admin admin] RBAC: Authorizing `identity:get_project(project_id=ccbc591f84f8431abfe14b7bddd59ecf)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:48.697323 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055e499-4885-4273-a34b-5594021ae483 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:48.699012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 678/1350] 10.222.0.16 () {56 vars in 1208 bytes} [Sun Aug 29 14:29:48 2021] GET /identity/v3/projects/ccbc591f84f8431abfe14b7bddd59ecf => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:48.705334 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506e472-00b1-4160-ac93-53418074915f None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:48.714814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506e472-00b1-4160-ac93-53418074915f None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:48.719282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b28e9-ca95-44cc-bad6-60f94cb1f04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:48.719915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b28e9-ca95-44cc-bad6-60f94cb1f04b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:48.720192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b28e9-ca95-44cc-bad6-60f94cb1f04b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:48.720465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b28e9-ca95-44cc-bad6-60f94cb1f04b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:48.721215 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b28e9-ca95-44cc-bad6-60f94cb1f04b admin admin] RBAC: Adding query filter params (scope.project.id=ccbc591f84f8431abfe14b7bddd59ecf) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:29:48.721517 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b28e9-ca95-44cc-bad6-60f94cb1f04b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:48.723375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b28e9-ca95-44cc-bad6-60f94cb1f04b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:48.728557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 673/1351] 10.222.0.16 () {56 vars in 1232 bytes} [Sun Aug 29 14:29:48 2021] GET /identity/v3/role_assignments?scope.project.id=ccbc591f84f8431abfe14b7bddd59ecf => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:48.734596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055e499-4885-4273-a34b-5594021ae483 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:48.744291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055e499-4885-4273-a34b-5594021ae483 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:48.748775 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98651c35-2686-4311-81e8-d0d3a05b1b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:48.749606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98651c35-2686-4311-81e8-d0d3a05b1b14 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:48.749906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98651c35-2686-4311-81e8-d0d3a05b1b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:48.750181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98651c35-2686-4311-81e8-d0d3a05b1b14 admin admin] PATH_INFO: `/v3/users/7b3af60575154adca1fde17caac19ae8` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:48.751330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98651c35-2686-4311-81e8-d0d3a05b1b14 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b3af60575154adca1fde17caac19ae8)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:48.753403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98651c35-2686-4311-81e8-d0d3a05b1b14 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:48.755607 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 679/1352] 10.222.0.16 () {56 vars in 1199 bytes} [Sun Aug 29 14:29:48 2021] GET /identity/v3/users/7b3af60575154adca1fde17caac19ae8 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:29:53.983685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ec0b4-a8ef-4436-9f93-f5b90a88ef88 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:53.984173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ec0b4-a8ef-4436-9f93-f5b90a88ef88 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:53.984273 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ec0b4-a8ef-4436-9f93-f5b90a88ef88 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:53.986014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 674/1353] 10.222.0.16 () {54 vars in 918 bytes} [Sun Aug 29 14:29:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:53.991835 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b42aa-081b-4a7a-9e4f-9f1a77db593c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:53.992265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b42aa-081b-4a7a-9e4f-9f1a77db593c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:53.992369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b42aa-081b-4a7a-9e4f-9f1a77db593c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:54.010436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-fa1b42aa-081b-4a7a-9e4f-9f1a77db593c None None] MFA Rules not processed for user `b77a408df11844e2aacbb366019dc3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:54.011602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-fa1b42aa-081b-4a7a-9e4f-9f1a77db593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:54.020704 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 680/1354] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Aug 29 14:29:53 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:54.035392 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9308db-aeb6-496f-bfaa-9ced896ca082 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:54.035674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9308db-aeb6-496f-bfaa-9ced896ca082 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:54.035952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9308db-aeb6-496f-bfaa-9ced896ca082 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:54.037664 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 675/1355] 10.222.0.16 () {54 vars in 918 bytes} [Sun Aug 29 14:29:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:29:54.042693 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358d78-da15-443f-96ad-8468421238fb None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:54.042980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358d78-da15-443f-96ad-8468421238fb None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:54.043281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358d78-da15-443f-96ad-8468421238fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:54.060987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0e358d78-da15-443f-96ad-8468421238fb None None] MFA Rules not processed for user `d8c0afa8f09f4923b9c8ab2696156129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:54.062197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0e358d78-da15-443f-96ad-8468421238fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:54.071824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 681/1356] 10.222.0.16 () {58 vars in 1016 bytes} [Sun Aug 29 14:29:54 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:29:56.887693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164fc9-6a26-47a9-8f8c-98ce053b16f3 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:56.888249 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164fc9-6a26-47a9-8f8c-98ce053b16f3 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:56.888249 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164fc9-6a26-47a9-8f8c-98ce053b16f3 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:56.890000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 676/1357] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:29:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:56.896083 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312019-3a31-4eaa-85e7-c29b11a37f9b None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:56.896514 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312019-3a31-4eaa-85e7-c29b11a37f9b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:56.896628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312019-3a31-4eaa-85e7-c29b11a37f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:56.915040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-16312019-3a31-4eaa-85e7-c29b11a37f9b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:56.916203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-16312019-3a31-4eaa-85e7-c29b11a37f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:56.923758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 682/1358] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:29:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:29:56.968256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b164fc9-6a26-47a9-8f8c-98ce053b16f3 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:56.982178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b164fc9-6a26-47a9-8f8c-98ce053b16f3 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:56.987381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7bf04-4115-4efc-8b44-af1a6287e978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:56.988093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7bf04-4115-4efc-8b44-af1a6287e978 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:56.988419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7bf04-4115-4efc-8b44-af1a6287e978 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:56.988708 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7bf04-4115-4efc-8b44-af1a6287e978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:56.996730 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7bf04-4115-4efc-8b44-af1a6287e978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:56.998318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7bf04-4115-4efc-8b44-af1a6287e978 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:57.007784 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 677/1359] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:29:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:29:58.419981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d00e26-6b9a-428a-95ce-0d0517800767 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:58.420557 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d00e26-6b9a-428a-95ce-0d0517800767 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:58.420557 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d00e26-6b9a-428a-95ce-0d0517800767 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:58.422361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 683/1360] 10.222.0.16 () {54 vars in 911 bytes} [Sun Aug 29 14:29:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:29:58.428366 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822b526-ee55-4e4e-aa9d-b7a934d8842c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:58.428763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822b526-ee55-4e4e-aa9d-b7a934d8842c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:58.428935 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822b526-ee55-4e4e-aa9d-b7a934d8842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:58.446145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-4822b526-ee55-4e4e-aa9d-b7a934d8842c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:29:58.447381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4822b526-ee55-4e4e-aa9d-b7a934d8842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:29:58.454984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 678/1361] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Aug 29 14:29:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:29:58.607174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d00e26-6b9a-428a-95ce-0d0517800767 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:29:58.622248 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d00e26-6b9a-428a-95ce-0d0517800767 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:29:58.627496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac70c7-d5c9-41e6-8287-f52c951d1c30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:29:58.628123 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac70c7-d5c9-41e6-8287-f52c951d1c30 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:29:58.628404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac70c7-d5c9-41e6-8287-f52c951d1c30 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:29:58.628676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac70c7-d5c9-41e6-8287-f52c951d1c30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:29:58.636543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac70c7-d5c9-41e6-8287-f52c951d1c30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:29:58.638210 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac70c7-d5c9-41e6-8287-f52c951d1c30 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:29:58.648391 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 684/1362] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:29:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:00.058927 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb509c-8cb4-436c-8611-869255bb4412 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:00.059416 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb509c-8cb4-436c-8611-869255bb4412 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:00.059547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb509c-8cb4-436c-8611-869255bb4412 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:00.061301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 679/1363] 10.222.0.16 () {54 vars in 911 bytes} [Sun Aug 29 14:30:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:00.067609 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89d999-341a-4598-8b38-6ebb212acaca None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:00.068050 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89d999-341a-4598-8b38-6ebb212acaca None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:00.068166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89d999-341a-4598-8b38-6ebb212acaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:00.086193 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-5f89d999-341a-4598-8b38-6ebb212acaca None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:00.087490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5f89d999-341a-4598-8b38-6ebb212acaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:00.095158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 685/1364] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Aug 29 14:30:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:30:00.248384 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb509c-8cb4-436c-8611-869255bb4412 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:00.262729 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb509c-8cb4-436c-8611-869255bb4412 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:00.268018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824e7b0-1cbb-45c7-9762-fb0fa7dce42c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:00.268636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824e7b0-1cbb-45c7-9762-fb0fa7dce42c service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:00.268915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824e7b0-1cbb-45c7-9762-fb0fa7dce42c service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:00.269183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824e7b0-1cbb-45c7-9762-fb0fa7dce42c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:00.277026 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824e7b0-1cbb-45c7-9762-fb0fa7dce42c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:00.278893 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824e7b0-1cbb-45c7-9762-fb0fa7dce42c service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:00.287992 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 680/1365] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:01.686867 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d6f79-0332-4085-a67c-e5f101ce0f86 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:01.687463 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d6f79-0332-4085-a67c-e5f101ce0f86 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:01.687463 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d6f79-0332-4085-a67c-e5f101ce0f86 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:01.689188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 686/1366] 10.222.0.16 () {54 vars in 911 bytes} [Sun Aug 29 14:30:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:01.694800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313e71b-5c79-4794-9584-e060863ea415 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:01.695250 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313e71b-5c79-4794-9584-e060863ea415 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:01.695346 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313e71b-5c79-4794-9584-e060863ea415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:01.713793 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-4313e71b-5c79-4794-9584-e060863ea415 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:01.714999 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4313e71b-5c79-4794-9584-e060863ea415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:01.723331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 681/1367] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Aug 29 14:30:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:01.888451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d6f79-0332-4085-a67c-e5f101ce0f86 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:01.903376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d6f79-0332-4085-a67c-e5f101ce0f86 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:01.908743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154a344-89b1-48c5-8403-80ed06ff0d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:01.909374 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154a344-89b1-48c5-8403-80ed06ff0d9f service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:01.910068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154a344-89b1-48c5-8403-80ed06ff0d9f service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:01.910373 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154a344-89b1-48c5-8403-80ed06ff0d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:01.918240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154a344-89b1-48c5-8403-80ed06ff0d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:01.919827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154a344-89b1-48c5-8403-80ed06ff0d9f service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:01.929913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 687/1368] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:03.317984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26febb46-9903-4f2a-97ae-03b55fff434e None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:03.318504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26febb46-9903-4f2a-97ae-03b55fff434e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:03.318601 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26febb46-9903-4f2a-97ae-03b55fff434e None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:03.320284 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 682/1369] 10.222.0.16 () {54 vars in 911 bytes} [Sun Aug 29 14:30:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:03.325701 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f0cc1-eb61-4508-94c8-03b3882cb6ae None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:03.326150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f0cc1-eb61-4508-94c8-03b3882cb6ae None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:03.326283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f0cc1-eb61-4508-94c8-03b3882cb6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:03.344990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b21f0cc1-eb61-4508-94c8-03b3882cb6ae None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:03.346200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b21f0cc1-eb61-4508-94c8-03b3882cb6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:03.354786 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 688/1370] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Aug 29 14:30:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:30:03.508918 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26febb46-9903-4f2a-97ae-03b55fff434e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:03.523646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26febb46-9903-4f2a-97ae-03b55fff434e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:03.528994 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329b4f2-ae34-46f1-bb8f-25a193831178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:03.529621 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329b4f2-ae34-46f1-bb8f-25a193831178 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:03.529924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329b4f2-ae34-46f1-bb8f-25a193831178 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:03.530197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329b4f2-ae34-46f1-bb8f-25a193831178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:03.538255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329b4f2-ae34-46f1-bb8f-25a193831178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:03.539806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329b4f2-ae34-46f1-bb8f-25a193831178 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:03.548786 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 683/1371] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:04.943789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f91483-b92f-49e8-82c8-3c821e75d67d None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:04.944335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f91483-b92f-49e8-82c8-3c821e75d67d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:04.944335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f91483-b92f-49e8-82c8-3c821e75d67d None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:04.946171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 689/1372] 10.222.0.16 () {54 vars in 911 bytes} [Sun Aug 29 14:30:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:04.951781 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e5246-1a28-4f49-ae15-206c0ecffa72 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:04.952227 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e5246-1a28-4f49-ae15-206c0ecffa72 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:04.952321 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e5246-1a28-4f49-ae15-206c0ecffa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:04.969983 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-697e5246-1a28-4f49-ae15-206c0ecffa72 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:04.971185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-697e5246-1a28-4f49-ae15-206c0ecffa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:04.979064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 684/1373] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Aug 29 14:30:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:05.136008 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f91483-b92f-49e8-82c8-3c821e75d67d None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:05.150379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f91483-b92f-49e8-82c8-3c821e75d67d None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:05.155730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8a55b-85ad-4a86-a8e0-c77e2cf325c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:05.159002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8a55b-85ad-4a86-a8e0-c77e2cf325c0 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:05.159002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8a55b-85ad-4a86-a8e0-c77e2cf325c0 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:05.159002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8a55b-85ad-4a86-a8e0-c77e2cf325c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:05.164827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8a55b-85ad-4a86-a8e0-c77e2cf325c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:05.166472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8a55b-85ad-4a86-a8e0-c77e2cf325c0 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:05.175575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 690/1374] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:30:06.535331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62ecc4-e287-4194-8e18-f4cc3f6bcc5e None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:06.535864 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62ecc4-e287-4194-8e18-f4cc3f6bcc5e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:06.535864 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62ecc4-e287-4194-8e18-f4cc3f6bcc5e None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:06.537603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 685/1375] 10.222.0.16 () {54 vars in 911 bytes} [Sun Aug 29 14:30:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:06.543240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf32b4-62d5-408d-b486-9f6cb432c156 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:06.543687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf32b4-62d5-408d-b486-9f6cb432c156 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:06.543792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf32b4-62d5-408d-b486-9f6cb432c156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:06.561653 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-8aaf32b4-62d5-408d-b486-9f6cb432c156 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:06.562871 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8aaf32b4-62d5-408d-b486-9f6cb432c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:06.570996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 691/1376] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Aug 29 14:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:30:06.721302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62ecc4-e287-4194-8e18-f4cc3f6bcc5e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:06.735800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62ecc4-e287-4194-8e18-f4cc3f6bcc5e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:06.745442 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3562d-fc07-4cfb-bff1-29ca360b7612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:06.746107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3562d-fc07-4cfb-bff1-29ca360b7612 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:06.746382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3562d-fc07-4cfb-bff1-29ca360b7612 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:06.746649 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3562d-fc07-4cfb-bff1-29ca360b7612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:06.755641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3562d-fc07-4cfb-bff1-29ca360b7612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:06.757206 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3562d-fc07-4cfb-bff1-29ca360b7612 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:06.766217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 686/1377] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:08.177059 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64832a0-7691-48ab-be65-37c34270e268 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:08.177624 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64832a0-7691-48ab-be65-37c34270e268 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:08.177624 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64832a0-7691-48ab-be65-37c34270e268 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:08.179399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 692/1378] 10.222.0.16 () {54 vars in 911 bytes} [Sun Aug 29 14:30:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:30:08.184958 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f285c0-353c-473f-ae9a-46176ab74412 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:08.185373 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f285c0-353c-473f-ae9a-46176ab74412 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:08.185506 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f285c0-353c-473f-ae9a-46176ab74412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:08.202538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-21f285c0-353c-473f-ae9a-46176ab74412 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:08.203707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-21f285c0-353c-473f-ae9a-46176ab74412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:08.211316 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 687/1379] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Aug 29 14:30:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:08.365432 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64832a0-7691-48ab-be65-37c34270e268 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:08.382407 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64832a0-7691-48ab-be65-37c34270e268 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:08.387719 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966bb21-66a5-4039-951a-a1b8dd67b952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:08.388352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966bb21-66a5-4039-951a-a1b8dd67b952 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:08.388629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966bb21-66a5-4039-951a-a1b8dd67b952 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:08.388903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966bb21-66a5-4039-951a-a1b8dd67b952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:08.397651 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966bb21-66a5-4039-951a-a1b8dd67b952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:08.399258 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966bb21-66a5-4039-951a-a1b8dd67b952 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:08.408672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 693/1380] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:09.808788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364ffc4-1f13-41e7-bae7-662bf2c498b5 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:09.809451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364ffc4-1f13-41e7-bae7-662bf2c498b5 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:09.809451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364ffc4-1f13-41e7-bae7-662bf2c498b5 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:09.811108 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 688/1381] 10.222.0.16 () {54 vars in 911 bytes} [Sun Aug 29 14:30:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:09.817010 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d276012-e36e-4caf-b802-5a26aae211e4 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:09.817458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d276012-e36e-4caf-b802-5a26aae211e4 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:09.817554 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d276012-e36e-4caf-b802-5a26aae211e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:09.835874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-4d276012-e36e-4caf-b802-5a26aae211e4 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:09.837081 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4d276012-e36e-4caf-b802-5a26aae211e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:09.844750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 694/1382] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Aug 29 14:30:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:30:10.004836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364ffc4-1f13-41e7-bae7-662bf2c498b5 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:10.019638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364ffc4-1f13-41e7-bae7-662bf2c498b5 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:10.025002 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c7e48-0092-4f06-a3a6-39e098602bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:10.025627 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c7e48-0092-4f06-a3a6-39e098602bc0 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:10.031092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c7e48-0092-4f06-a3a6-39e098602bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:10.031092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c7e48-0092-4f06-a3a6-39e098602bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:10.035413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c7e48-0092-4f06-a3a6-39e098602bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:10.036989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c7e48-0092-4f06-a3a6-39e098602bc0 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:10.046419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 689/1383] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:12.118427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc130f1-8347-435c-baa2-27fc0c0afe03 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:12.118970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc130f1-8347-435c-baa2-27fc0c0afe03 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:12.118970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc130f1-8347-435c-baa2-27fc0c0afe03 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:12.120769 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 695/1384] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:12.126574 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04096fe-71ec-48c3-b91c-d301ce8efe41 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:12.127083 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04096fe-71ec-48c3-b91c-d301ce8efe41 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:12.127183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04096fe-71ec-48c3-b91c-d301ce8efe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:12.146149 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-b04096fe-71ec-48c3-b91c-d301ce8efe41 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:12.147331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b04096fe-71ec-48c3-b91c-d301ce8efe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:12.154982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 690/1385] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:12.194814 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc130f1-8347-435c-baa2-27fc0c0afe03 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:12.205467 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc130f1-8347-435c-baa2-27fc0c0afe03 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:12.208988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08952473-18af-4c16-8d29-03adc6043ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:12.209607 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08952473-18af-4c16-8d29-03adc6043ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:12.209907 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08952473-18af-4c16-8d29-03adc6043ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:12.210184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08952473-18af-4c16-8d29-03adc6043ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:12.218698 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08952473-18af-4c16-8d29-03adc6043ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:12.220109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08952473-18af-4c16-8d29-03adc6043ee8 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:12.229049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 696/1386] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:30:14.540543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df03cf8-fb01-41c6-9032-78c97239d29b None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:14.541118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df03cf8-fb01-41c6-9032-78c97239d29b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:14.541118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df03cf8-fb01-41c6-9032-78c97239d29b None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:14.542942 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 691/1387] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:14.548782 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d40e1-9a7c-4902-b74b-aa181138d289 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:14.549199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d40e1-9a7c-4902-b74b-aa181138d289 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:14.549360 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d40e1-9a7c-4902-b74b-aa181138d289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:14.567888 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-225d40e1-9a7c-4902-b74b-aa181138d289 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:14.569057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-225d40e1-9a7c-4902-b74b-aa181138d289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:14.576630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 697/1388] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:30:14.614995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df03cf8-fb01-41c6-9032-78c97239d29b None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:14.625696 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df03cf8-fb01-41c6-9032-78c97239d29b None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:14.629735 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9391e-b23e-4490-a247-05769cd7c207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:14.630396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9391e-b23e-4490-a247-05769cd7c207 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:14.630669 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9391e-b23e-4490-a247-05769cd7c207 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:14.630938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9391e-b23e-4490-a247-05769cd7c207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:14.639374 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9391e-b23e-4490-a247-05769cd7c207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:14.640833 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9391e-b23e-4490-a247-05769cd7c207 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:14.650308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 692/1389] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:17.288914 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc575aad-806f-47f5-9d12-39ab684c3ccd None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:17.289430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc575aad-806f-47f5-9d12-39ab684c3ccd None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:17.289551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc575aad-806f-47f5-9d12-39ab684c3ccd None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:17.291304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 698/1390] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:17.297240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ac499-c220-4ea7-af31-50c0e1587ab7 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:17.297743 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ac499-c220-4ea7-af31-50c0e1587ab7 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:17.297850 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ac499-c220-4ea7-af31-50c0e1587ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:17.315567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f47ac499-c220-4ea7-af31-50c0e1587ab7 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:17.316743 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f47ac499-c220-4ea7-af31-50c0e1587ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:17.324320 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 693/1391] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:17.364166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc575aad-806f-47f5-9d12-39ab684c3ccd None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:17.376293 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc575aad-806f-47f5-9d12-39ab684c3ccd None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:17.382575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbbe6b-e133-4087-a075-477d3363c2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:17.383214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbbe6b-e133-4087-a075-477d3363c2ae service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:17.383613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbbe6b-e133-4087-a075-477d3363c2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:17.383942 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbbe6b-e133-4087-a075-477d3363c2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:17.393698 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbbe6b-e133-4087-a075-477d3363c2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:17.395142 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbbe6b-e133-4087-a075-477d3363c2ae service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:17.404268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 699/1392] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:30:19.679219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7311ef-9573-4dec-b557-e0816a1a27c6 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:19.679840 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7311ef-9573-4dec-b557-e0816a1a27c6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:19.679840 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7311ef-9573-4dec-b557-e0816a1a27c6 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:19.681556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 694/1393] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:19.687430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3a038-aead-425c-8399-6a70aa617e26 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:19.687845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3a038-aead-425c-8399-6a70aa617e26 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:19.688011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3a038-aead-425c-8399-6a70aa617e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:19.706121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0df3a038-aead-425c-8399-6a70aa617e26 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:19.707324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0df3a038-aead-425c-8399-6a70aa617e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:19.715156 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 700/1394] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:30:19.754195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7311ef-9573-4dec-b557-e0816a1a27c6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:19.764426 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7311ef-9573-4dec-b557-e0816a1a27c6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:19.768457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2d717-6976-48ea-8f2f-31cf5231f005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:19.769133 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d717-6976-48ea-8f2f-31cf5231f005 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:19.769439 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d717-6976-48ea-8f2f-31cf5231f005 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:19.769712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d717-6976-48ea-8f2f-31cf5231f005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:19.781474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2d717-6976-48ea-8f2f-31cf5231f005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:19.782933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2d717-6976-48ea-8f2f-31cf5231f005 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:19.792782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 695/1395] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:21.982497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5e3f1-6417-478f-9652-ebbada2e5030 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:21.983057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5e3f1-6417-478f-9652-ebbada2e5030 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:21.983057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5e3f1-6417-478f-9652-ebbada2e5030 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:21.984848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 701/1396] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:21.991537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204d283-ac90-4776-b2e0-fe31754f1367 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:21.992215 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204d283-ac90-4776-b2e0-fe31754f1367 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:21.992511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204d283-ac90-4776-b2e0-fe31754f1367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:22.010341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0204d283-ac90-4776-b2e0-fe31754f1367 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:22.011528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0204d283-ac90-4776-b2e0-fe31754f1367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:22.019232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 696/1397] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:22.058504 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5e3f1-6417-478f-9652-ebbada2e5030 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:22.069621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5e3f1-6417-478f-9652-ebbada2e5030 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:22.073431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c500b-2f77-4f2b-b0e2-f1effef70978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:22.074114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c500b-2f77-4f2b-b0e2-f1effef70978 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:22.074402 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c500b-2f77-4f2b-b0e2-f1effef70978 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:22.074680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c500b-2f77-4f2b-b0e2-f1effef70978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:22.084415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c500b-2f77-4f2b-b0e2-f1effef70978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:22.085907 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c500b-2f77-4f2b-b0e2-f1effef70978 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:22.095608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 702/1398] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:24.292344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371cdba-2aff-47cb-bea4-6da7d48e3823 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:24.292889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371cdba-2aff-47cb-bea4-6da7d48e3823 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:24.292889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371cdba-2aff-47cb-bea4-6da7d48e3823 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:24.294666 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 697/1399] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:24.301183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f471ea-a3fd-4464-b0e4-57b23ed18c50 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:24.301631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f471ea-a3fd-4464-b0e4-57b23ed18c50 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:24.301739 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f471ea-a3fd-4464-b0e4-57b23ed18c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:24.319794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-39f471ea-a3fd-4464-b0e4-57b23ed18c50 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:24.320982 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-39f471ea-a3fd-4464-b0e4-57b23ed18c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:24.328942 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 703/1400] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:30:24.367877 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371cdba-2aff-47cb-bea4-6da7d48e3823 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:24.379021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371cdba-2aff-47cb-bea4-6da7d48e3823 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:24.382606 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d23ae-b23c-4f21-a61b-7142cf201663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:24.383236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d23ae-b23c-4f21-a61b-7142cf201663 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:24.383517 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d23ae-b23c-4f21-a61b-7142cf201663 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:24.383792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d23ae-b23c-4f21-a61b-7142cf201663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:24.392664 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d23ae-b23c-4f21-a61b-7142cf201663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:24.394009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d23ae-b23c-4f21-a61b-7142cf201663 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:24.403369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 698/1401] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:26.605536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90183-0e0f-4411-ba09-4d566cfefec5 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:26.606121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90183-0e0f-4411-ba09-4d566cfefec5 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:26.606121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90183-0e0f-4411-ba09-4d566cfefec5 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:26.607874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 704/1402] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:26.614369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0649d1c-305c-4be8-ab20-25486c777f69 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:26.614853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0649d1c-305c-4be8-ab20-25486c777f69 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:26.614958 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0649d1c-305c-4be8-ab20-25486c777f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:26.632714 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c0649d1c-305c-4be8-ab20-25486c777f69 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:26.633924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c0649d1c-305c-4be8-ab20-25486c777f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:26.641697 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 699/1403] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:26.680879 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90183-0e0f-4411-ba09-4d566cfefec5 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:26.691363 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90183-0e0f-4411-ba09-4d566cfefec5 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:26.694837 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512c005-0e75-40a9-a601-78c88fed5a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:26.695457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512c005-0e75-40a9-a601-78c88fed5a94 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:26.695734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512c005-0e75-40a9-a601-78c88fed5a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:26.696009 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512c005-0e75-40a9-a601-78c88fed5a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:26.706141 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512c005-0e75-40a9-a601-78c88fed5a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:26.707583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512c005-0e75-40a9-a601-78c88fed5a94 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:26.716826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 705/1404] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:28.908740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d267295-f099-402c-9c81-fefa7fb0e777 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:28.909309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d267295-f099-402c-9c81-fefa7fb0e777 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:28.909309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d267295-f099-402c-9c81-fefa7fb0e777 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:28.911088 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 700/1405] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:28.917121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a20bcb-d126-46db-90ed-5c1c19034814 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:28.917553 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a20bcb-d126-46db-90ed-5c1c19034814 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:28.917673 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a20bcb-d126-46db-90ed-5c1c19034814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:28.935921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-32a20bcb-d126-46db-90ed-5c1c19034814 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:28.937140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-32a20bcb-d126-46db-90ed-5c1c19034814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:28.945445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 706/1406] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:28.983646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d267295-f099-402c-9c81-fefa7fb0e777 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:28.994996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d267295-f099-402c-9c81-fefa7fb0e777 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:28.998404 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01397d28-f345-4916-95ed-f3c8d6050b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:28.999048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01397d28-f345-4916-95ed-f3c8d6050b86 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:28.999307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01397d28-f345-4916-95ed-f3c8d6050b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:28.999576 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01397d28-f345-4916-95ed-f3c8d6050b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:29.009415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01397d28-f345-4916-95ed-f3c8d6050b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:29.010917 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01397d28-f345-4916-95ed-f3c8d6050b86 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:29.020530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 701/1407] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:31.202802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067f556-f67c-4a35-b3e6-9efb096ece65 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:31.203385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067f556-f67c-4a35-b3e6-9efb096ece65 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:31.203385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067f556-f67c-4a35-b3e6-9efb096ece65 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:31.205499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 707/1408] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:31.211531 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbacc8-de90-4e91-bfbd-ac45b41b21c6 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:31.211999 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbacc8-de90-4e91-bfbd-ac45b41b21c6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:31.212169 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbacc8-de90-4e91-bfbd-ac45b41b21c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:31.230255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-77dbacc8-de90-4e91-bfbd-ac45b41b21c6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:31.231434 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-77dbacc8-de90-4e91-bfbd-ac45b41b21c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:31.239838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 702/1409] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:31.277823 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067f556-f67c-4a35-b3e6-9efb096ece65 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:31.288964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067f556-f67c-4a35-b3e6-9efb096ece65 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:31.292511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82719337-975d-4d51-9531-14c6a4a9e2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:31.293141 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82719337-975d-4d51-9531-14c6a4a9e2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:31.293422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82719337-975d-4d51-9531-14c6a4a9e2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:31.293698 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82719337-975d-4d51-9531-14c6a4a9e2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:31.303004 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82719337-975d-4d51-9531-14c6a4a9e2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:31.304432 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82719337-975d-4d51-9531-14c6a4a9e2f1 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:31.313925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 708/1410] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:33.492564 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a121b-2523-4494-86e8-eefccf81ab51 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:33.493092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a121b-2523-4494-86e8-eefccf81ab51 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:33.493092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a121b-2523-4494-86e8-eefccf81ab51 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:33.494999 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 703/1411] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:33.501035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc528c59-dd1a-482d-afb4-a18829ed52f2 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:33.502174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc528c59-dd1a-482d-afb4-a18829ed52f2 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:33.502174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc528c59-dd1a-482d-afb4-a18829ed52f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:33.519541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-bc528c59-dd1a-482d-afb4-a18829ed52f2 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:33.520721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-bc528c59-dd1a-482d-afb4-a18829ed52f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:33.528358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 709/1412] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:30:33.566231 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a121b-2523-4494-86e8-eefccf81ab51 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:33.576690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a121b-2523-4494-86e8-eefccf81ab51 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:33.580850 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d9822-2934-4857-8926-22c7b3ef79a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:33.581486 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d9822-2934-4857-8926-22c7b3ef79a1 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:33.581766 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d9822-2934-4857-8926-22c7b3ef79a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:33.582091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d9822-2934-4857-8926-22c7b3ef79a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:33.591020 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d9822-2934-4857-8926-22c7b3ef79a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:33.592476 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d9822-2934-4857-8926-22c7b3ef79a1 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:33.602348 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 704/1413] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:50.765199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb01838-b1f9-45fd-b218-0d839449d0b3 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:50.765809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb01838-b1f9-45fd-b218-0d839449d0b3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:50.765809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb01838-b1f9-45fd-b218-0d839449d0b3 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:50.767754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 710/1414] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:50.773681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149fda6-c7ec-4a96-abe1-e4df51f5800a None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:50.774149 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149fda6-c7ec-4a96-abe1-e4df51f5800a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:50.774278 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149fda6-c7ec-4a96-abe1-e4df51f5800a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:50.791951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-4149fda6-c7ec-4a96-abe1-e4df51f5800a None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:50.793117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4149fda6-c7ec-4a96-abe1-e4df51f5800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:50.801274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 705/1415] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:50.850480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817aaba-d314-4b97-9674-2b0b12a51bce None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:50.850765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817aaba-d314-4b97-9674-2b0b12a51bce None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:50.851043 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817aaba-d314-4b97-9674-2b0b12a51bce None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:50.852798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 711/1416] 10.222.0.16 () {54 vars in 966 bytes} [Sun Aug 29 14:30:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:50.857714 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84d562-a260-402e-b8ec-e09b7e264acb None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:50.858023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84d562-a260-402e-b8ec-e09b7e264acb None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:50.858296 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84d562-a260-402e-b8ec-e09b7e264acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:50.877118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-6e84d562-a260-402e-b8ec-e09b7e264acb None None] MFA Rules not processed for user `db83070471e34df695b571cdab440b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:50.878379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-6e84d562-a260-402e-b8ec-e09b7e264acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:50.884697 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 706/1417] 10.222.0.16 () {58 vars in 1064 bytes} [Sun Aug 29 14:30:50 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:50.892884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817aaba-d314-4b97-9674-2b0b12a51bce None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:50.903565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817aaba-d314-4b97-9674-2b0b12a51bce None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:50.908376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7841c6-c0f7-4ac0-9378-ba7f242c3026 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db83070471e34df695b571cdab440b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:50.909024 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7841c6-c0f7-4ac0-9378-ba7f242c3026 service glance] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:50.909304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7841c6-c0f7-4ac0-9378-ba7f242c3026 service glance] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:50.909577 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7841c6-c0f7-4ac0-9378-ba7f242c3026 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:50.918347 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7841c6-c0f7-4ac0-9378-ba7f242c3026 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:50.919772 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7841c6-c0f7-4ac0-9378-ba7f242c3026 service glance] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:50.929500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 712/1418] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:53.191621 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6018b3-0e03-4b64-b34b-b4ffc02d5888 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:53.192152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6018b3-0e03-4b64-b34b-b4ffc02d5888 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:53.192152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6018b3-0e03-4b64-b34b-b4ffc02d5888 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:53.193910 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 707/1419] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:30:53.199837 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83c8b-c51f-45e2-a8df-a7493e997c9e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:53.205317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83c8b-c51f-45e2-a8df-a7493e997c9e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:53.205317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83c8b-c51f-45e2-a8df-a7493e997c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:53.217794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-50b83c8b-c51f-45e2-a8df-a7493e997c9e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:53.219575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-50b83c8b-c51f-45e2-a8df-a7493e997c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:53.227259 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 713/1420] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:53.253105 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6018b3-0e03-4b64-b34b-b4ffc02d5888 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:53.265127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6018b3-0e03-4b64-b34b-b4ffc02d5888 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:53.269724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84dd41-30c2-4035-91cc-b398fcfb275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:53.270386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84dd41-30c2-4035-91cc-b398fcfb275f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:53.270664 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84dd41-30c2-4035-91cc-b398fcfb275f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:53.270932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84dd41-30c2-4035-91cc-b398fcfb275f admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:53.271641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84dd41-30c2-4035-91cc-b398fcfb275f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:53.273454 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84dd41-30c2-4035-91cc-b398fcfb275f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:53.292014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 708/1421] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Aug 29 14:30:53 2021] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:30:55.473400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8da6e-a6f5-43f1-81ad-d40d480f5631 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:55.474016 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8da6e-a6f5-43f1-81ad-d40d480f5631 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:55.474016 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8da6e-a6f5-43f1-81ad-d40d480f5631 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:55.475723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 714/1422] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:55.481652 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b871598-1bfb-42bb-9d6c-0fb42aebd82c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:55.482140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b871598-1bfb-42bb-9d6c-0fb42aebd82c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:55.482252 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b871598-1bfb-42bb-9d6c-0fb42aebd82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:55.500336 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-9b871598-1bfb-42bb-9d6c-0fb42aebd82c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:55.501532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-9b871598-1bfb-42bb-9d6c-0fb42aebd82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:55.509080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 709/1423] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:30:55.553391 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8da6e-a6f5-43f1-81ad-d40d480f5631 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:55.567430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8da6e-a6f5-43f1-81ad-d40d480f5631 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:55.572740 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a573b-5589-4608-a96b-9686f6effc04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:55.573369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a573b-5589-4608-a96b-9686f6effc04 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:55.573648 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a573b-5589-4608-a96b-9686f6effc04 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:55.573953 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a573b-5589-4608-a96b-9686f6effc04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:55.581793 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a573b-5589-4608-a96b-9686f6effc04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:55.583383 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a573b-5589-4608-a96b-9686f6effc04 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:55.592400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 715/1424] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:30:57.958945 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be8b95-7c3a-40b2-962c-5f41842fd7f3 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:57.959444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be8b95-7c3a-40b2-962c-5f41842fd7f3 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:57.959552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be8b95-7c3a-40b2-962c-5f41842fd7f3 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:57.961342 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 710/1425] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:30:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:30:57.967362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f61f9-bc89-4b22-a92a-5ad2f4c42ab8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:57.967777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f61f9-bc89-4b22-a92a-5ad2f4c42ab8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:57.967931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f61f9-bc89-4b22-a92a-5ad2f4c42ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:57.985855 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3c1f61f9-bc89-4b22-a92a-5ad2f4c42ab8 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:30:57.987065 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3c1f61f9-bc89-4b22-a92a-5ad2f4c42ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:30:57.995052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 716/1426] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:30:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:30:58.032753 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be8b95-7c3a-40b2-962c-5f41842fd7f3 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:30:58.043170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be8b95-7c3a-40b2-962c-5f41842fd7f3 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:30:58.047423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93df568-65a0-46e7-86de-5f4acd1868a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:30:58.048062 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93df568-65a0-46e7-86de-5f4acd1868a3 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:30:58.048345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93df568-65a0-46e7-86de-5f4acd1868a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:30:58.048619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93df568-65a0-46e7-86de-5f4acd1868a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:30:58.057496 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93df568-65a0-46e7-86de-5f4acd1868a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:30:58.058953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93df568-65a0-46e7-86de-5f4acd1868a3 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:30:58.068895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 711/1427] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:30:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:31:00.339974 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d57126-1bcf-4420-a078-ae45d0713aad None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:31:00.340540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d57126-1bcf-4420-a078-ae45d0713aad None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:31:00.340540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d57126-1bcf-4420-a078-ae45d0713aad None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:31:00.342377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 717/1428] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:31:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:31:00.348903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e0a3e-3832-4a42-89f9-8860e182a26b None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:31:00.349340 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e0a3e-3832-4a42-89f9-8860e182a26b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:31:00.349477 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e0a3e-3832-4a42-89f9-8860e182a26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:31:00.368870 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0f9e0a3e-3832-4a42-89f9-8860e182a26b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:31:00.370113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0f9e0a3e-3832-4a42-89f9-8860e182a26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:31:00.378489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 712/1429] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:31:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:31:00.416916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d57126-1bcf-4420-a078-ae45d0713aad None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:31:00.428020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d57126-1bcf-4420-a078-ae45d0713aad None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:31:00.431532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4175c-9418-474f-81d1-8f073353722e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:31:00.432359 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4175c-9418-474f-81d1-8f073353722e service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:31:00.432652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4175c-9418-474f-81d1-8f073353722e service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:31:00.432926 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4175c-9418-474f-81d1-8f073353722e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:31:00.442261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4175c-9418-474f-81d1-8f073353722e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:31:00.443676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4175c-9418-474f-81d1-8f073353722e service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:31:00.452684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 718/1430] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:31:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:31:02.698427 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a5d42-dc84-4bcd-ba5c-754216151324 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:31:02.698989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a5d42-dc84-4bcd-ba5c-754216151324 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:31:02.698989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a5d42-dc84-4bcd-ba5c-754216151324 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:31:02.700722 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 713/1431] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:31:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:31:02.706933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a2d9e-6d5f-47e6-9b90-27a46ba5c1a3 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:31:02.707365 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a2d9e-6d5f-47e6-9b90-27a46ba5c1a3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:31:02.707512 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a2d9e-6d5f-47e6-9b90-27a46ba5c1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:31:02.724560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-5f0a2d9e-6d5f-47e6-9b90-27a46ba5c1a3 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:31:02.725726 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5f0a2d9e-6d5f-47e6-9b90-27a46ba5c1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:31:02.733250 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 719/1432] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:31:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:31:02.775050 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a5d42-dc84-4bcd-ba5c-754216151324 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:31:02.785789 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a5d42-dc84-4bcd-ba5c-754216151324 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:31:02.789227 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728497b-74db-415c-a31c-2af7cf82af29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:31:02.789848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728497b-74db-415c-a31c-2af7cf82af29 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:31:02.790156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728497b-74db-415c-a31c-2af7cf82af29 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:31:02.790430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728497b-74db-415c-a31c-2af7cf82af29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:31:02.799452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728497b-74db-415c-a31c-2af7cf82af29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:31:02.800858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728497b-74db-415c-a31c-2af7cf82af29 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:31:02.809759 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 714/1433] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:31:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:31:05.338139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6196db0-db71-4dee-9e61-88531248b929 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:31:05.338726 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6196db0-db71-4dee-9e61-88531248b929 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:31:05.338726 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6196db0-db71-4dee-9e61-88531248b929 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:31:05.340472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 720/1434] 10.222.0.16 () {54 vars in 926 bytes} [Sun Aug 29 14:31:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:31:05.346824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b18716-0f11-4a4e-b199-39edced4651b None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:31:05.347282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b18716-0f11-4a4e-b199-39edced4651b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:31:05.347378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b18716-0f11-4a4e-b199-39edced4651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:31:05.365361 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-97b18716-0f11-4a4e-b199-39edced4651b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:31:05.366569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-97b18716-0f11-4a4e-b199-39edced4651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:31:05.374174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 715/1435] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Aug 29 14:31:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:31:05.419834 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6196db0-db71-4dee-9e61-88531248b929 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:31:05.431028 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6196db0-db71-4dee-9e61-88531248b929 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:31:05.434583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9766d4-b1eb-417e-9cc4-442c5dc3ce79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:31:05.435203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9766d4-b1eb-417e-9cc4-442c5dc3ce79 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:31:05.435480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9766d4-b1eb-417e-9cc4-442c5dc3ce79 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:31:05.435756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9766d4-b1eb-417e-9cc4-442c5dc3ce79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:31:05.444995 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9766d4-b1eb-417e-9cc4-442c5dc3ce79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:31:05.446444 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9766d4-b1eb-417e-9cc4-442c5dc3ce79 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:31:05.455843 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 721/1436] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:31:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:32:24.382080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08d682-bdb7-4883-bddc-be29b02f0b12 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:24.382669 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08d682-bdb7-4883-bddc-be29b02f0b12 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:24.382669 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08d682-bdb7-4883-bddc-be29b02f0b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:24.400103 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-2e08d682-bdb7-4883-bddc-be29b02f0b12 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:32:24.401339 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-2e08d682-bdb7-4883-bddc-be29b02f0b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:32:24.409777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 716/1437] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:32:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:32:24.418330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b1cc-346b-412d-9faa-e487645406e7 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:24.418842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b1cc-346b-412d-9faa-e487645406e7 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:24.418952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b1cc-346b-412d-9faa-e487645406e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:24.436626 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c838b1cc-346b-412d-9faa-e487645406e7 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:32:24.437812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c838b1cc-346b-412d-9faa-e487645406e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:32:24.445595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 722/1438] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:32:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:32:24.450330 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08d682-bdb7-4883-bddc-be29b02f0b12 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:32:24.459610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08d682-bdb7-4883-bddc-be29b02f0b12 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:32:24.464071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bb1c5-4065-4466-b245-19d86e2b3518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:32:24.465282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bb1c5-4065-4466-b245-19d86e2b3518 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:24.465558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bb1c5-4065-4466-b245-19d86e2b3518 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:24.465825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bb1c5-4065-4466-b245-19d86e2b3518 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:24.466659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bb1c5-4065-4466-b245-19d86e2b3518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:32:24.466964 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bb1c5-4065-4466-b245-19d86e2b3518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:32:24.468549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bb1c5-4065-4466-b245-19d86e2b3518 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:32:24.479445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 717/1439] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:32:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:32:24.488083 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b1cc-346b-412d-9faa-e487645406e7 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:32:24.497062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b1cc-346b-412d-9faa-e487645406e7 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:32:24.501562 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c85014-b575-40db-9875-0ea0c8a07b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:32:24.502237 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85014-b575-40db-9875-0ea0c8a07b8d admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:24.502515 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85014-b575-40db-9875-0ea0c8a07b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:24.502786 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85014-b575-40db-9875-0ea0c8a07b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:24.503456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c85014-b575-40db-9875-0ea0c8a07b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:32:24.505319 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c85014-b575-40db-9875-0ea0c8a07b8d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:32:24.633483 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 723/1440] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:32:24 2021] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:32:24.638376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bb1c5-4065-4466-b245-19d86e2b3518 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:32:24.648453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bb1c5-4065-4466-b245-19d86e2b3518 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:32:24.701082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c330c-d461-4649-a7d4-1e92008c6887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:32:24.701741 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c330c-d461-4649-a7d4-1e92008c6887 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:24.702055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c330c-d461-4649-a7d4-1e92008c6887 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:24.702329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c330c-d461-4649-a7d4-1e92008c6887 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:24.703001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c330c-d461-4649-a7d4-1e92008c6887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:32:24.704883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c330c-d461-4649-a7d4-1e92008c6887 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:32:24.798173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 718/1441] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:32:24 2021] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:32:24.802323 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c85014-b575-40db-9875-0ea0c8a07b8d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:32:24.812345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c85014-b575-40db-9875-0ea0c8a07b8d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:32:24.816793 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9395-4f96-4e3c-959f-661a95a8b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:32:24.817446 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9395-4f96-4e3c-959f-661a95a8b7ce admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:24.817727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9395-4f96-4e3c-959f-661a95a8b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:24.818042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9395-4f96-4e3c-959f-661a95a8b7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:24.818761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d9395-4f96-4e3c-959f-661a95a8b7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:32:24.820362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d9395-4f96-4e3c-959f-661a95a8b7ce admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:32:24.833249 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 724/1442] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:32:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:32:24.837223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c330c-d461-4649-a7d4-1e92008c6887 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:32:24.847571 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c330c-d461-4649-a7d4-1e92008c6887 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:32:24.852025 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e6cf4-4b72-4a1b-be4a-c6f260490f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:32:24.852667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e6cf4-4b72-4a1b-be4a-c6f260490f0a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:24.852944 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e6cf4-4b72-4a1b-be4a-c6f260490f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:24.853214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e6cf4-4b72-4a1b-be4a-c6f260490f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:24.853955 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e6cf4-4b72-4a1b-be4a-c6f260490f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:32:24.855549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e6cf4-4b72-4a1b-be4a-c6f260490f0a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:32:24.868451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 719/1443] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:32:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:32:24.872896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9395-4f96-4e3c-959f-661a95a8b7ce admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:32:24.882376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9395-4f96-4e3c-959f-661a95a8b7ce admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:32:24.887507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9abbba-2b49-4823-982a-7b060ace0fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:32:24.888310 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9abbba-2b49-4823-982a-7b060ace0fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:24.888589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9abbba-2b49-4823-982a-7b060ace0fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:24.888863 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9abbba-2b49-4823-982a-7b060ace0fe4 admin admin] PATH_INFO: `/v3/projects/4833d395580b4efaa54fc82b600f1ffa/users/34f5935d73ab492ab90ddcbf856b6ce4/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:24.903293 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9abbba-2b49-4823-982a-7b060ace0fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4833d395580b4efaa54fc82b600f1ffa, user_id=34f5935d73ab492ab90ddcbf856b6ce4, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:32:24.906086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9abbba-2b49-4823-982a-7b060ace0fe4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:32:24.975097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 725/1444] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:32:24 2021] PUT /identity/v3/projects/4833d395580b4efaa54fc82b600f1ffa/users/34f5935d73ab492ab90ddcbf856b6ce4/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:32:24.987549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89745a75-c6b6-4e01-8634-0aa32f34757b None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:24.987855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89745a75-c6b6-4e01-8634-0aa32f34757b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:24.988129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89745a75-c6b6-4e01-8634-0aa32f34757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:25.014298 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-89745a75-c6b6-4e01-8634-0aa32f34757b None None] MFA Rules not processed for user `34f5935d73ab492ab90ddcbf856b6ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:32:25.015490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-89745a75-c6b6-4e01-8634-0aa32f34757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:32:25.076174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 720/1445] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:32:24 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:32:25.087698 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9abbba-2b49-4823-982a-7b060ace0fe4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:32:25.161714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9abbba-2b49-4823-982a-7b060ace0fe4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:32:25.167067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd24754-3b00-4b0f-97cb-2d01ca5dba30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:32:25.168240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd24754-3b00-4b0f-97cb-2d01ca5dba30 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:25.168526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd24754-3b00-4b0f-97cb-2d01ca5dba30 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:25.168802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd24754-3b00-4b0f-97cb-2d01ca5dba30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:25.176343 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd24754-3b00-4b0f-97cb-2d01ca5dba30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:32:25.177961 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd24754-3b00-4b0f-97cb-2d01ca5dba30 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:32:25.187510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 726/1446] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:32:25 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:32:25.255930 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466e0a9-3cfd-4ef8-85b4-48e89312b184 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:25.256246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466e0a9-3cfd-4ef8-85b4-48e89312b184 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:25.256527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466e0a9-3cfd-4ef8-85b4-48e89312b184 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:25.258239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 721/1447] 10.222.0.16 () {52 vars in 829 bytes} [Sun Aug 29 14:32:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:32:25.262682 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd24754-3b00-4b0f-97cb-2d01ca5dba30 service nova] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:32:25.321871 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd24754-3b00-4b0f-97cb-2d01ca5dba30 service nova] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:32:25.326541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:32:25.327397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:25.327683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:25.327955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] PATH_INFO: `/v3/users/34f5935d73ab492ab90ddcbf856b6ce4` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:25.329133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f5935d73ab492ab90ddcbf856b6ce4)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:32:25.330187 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:32:25.330187 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:32:25.330187 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:32:25.331380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:32:25.589487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f5935d73ab492ab90ddcbf856b6ce4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:32:25.590191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f5935d73ab492ab90ddcbf856b6ce4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:32:25.590949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f5935d73ab492ab90ddcbf856b6ce4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:32:25.672063 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f5935d73ab492ab90ddcbf856b6ce4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:32:25.691456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f5935d73ab492ab90ddcbf856b6ce4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:32:25.708235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 727/1448] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:32:25 2021] DELETE /identity/v3/users/34f5935d73ab492ab90ddcbf856b6ce4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:32:25.712707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f79a77-6b35-4f51-ba58-7462908de960 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:25.713160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f79a77-6b35-4f51-ba58-7462908de960 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:25.713271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f79a77-6b35-4f51-ba58-7462908de960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:25.732730 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-35f79a77-6b35-4f51-ba58-7462908de960 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:32:25.733972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-35f79a77-6b35-4f51-ba58-7462908de960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:32:25.790811 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 722/1449] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:32:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:32:25.801018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:32:25.802458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:32:25.857429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9eb29-f98b-483c-aa78-634353b49c7e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:32:25.860990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ba766-fb21-42a8-b10a-98ae6b017f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:32:25.861902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ba766-fb21-42a8-b10a-98ae6b017f79 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:25.862190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ba766-fb21-42a8-b10a-98ae6b017f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:25.862466 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ba766-fb21-42a8-b10a-98ae6b017f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:25.871301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ba766-fb21-42a8-b10a-98ae6b017f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:32:25.872745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ba766-fb21-42a8-b10a-98ae6b017f79 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:32:25.881891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 728/1450] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:32:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:32:26.378035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f79a77-6b35-4f51-ba58-7462908de960 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:32:26.379556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-35f79a77-6b35-4f51-ba58-7462908de960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:32:26.392078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f79a77-6b35-4f51-ba58-7462908de960 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:32:26.397168 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:32:26.398055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:32:26.398334 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:32:26.398603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] PATH_INFO: `/v3/projects/4833d395580b4efaa54fc82b600f1ffa` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:32:26.399802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4833d395580b4efaa54fc82b600f1ffa)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:32:26.400807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:32:26.400807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:32:26.400807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:32:26.402307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:32:26.510681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4833d395580b4efaa54fc82b600f1ffa', 'request_id': 'req-8d09e8df-1578-44be-bd5f-edcb0d0d6050'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:32:26.575451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4833d395580b4efaa54fc82b600f1ffa', 'request_id': 'req-8d09e8df-1578-44be-bd5f-edcb0d0d6050'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:32:26.581693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4833d395580b4efaa54fc82b600f1ffa', 'request_id': 'req-8d09e8df-1578-44be-bd5f-edcb0d0d6050'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:32:26.601524 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] The token cache is being invalidate because project 4833d395580b4efaa54fc82b600f1ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:32:26.601807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:32:26.602474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8d09e8df-1578-44be-bd5f-edcb0d0d6050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:32:26.604052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 723/1451] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:32:26 2021] DELETE /identity/v3/projects/4833d395580b4efaa54fc82b600f1ffa => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:33:53.809019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe1472-6e40-41c7-b20f-95d9a99d4479 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:33:53.809691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe1472-6e40-41c7-b20f-95d9a99d4479 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:33:53.809691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe1472-6e40-41c7-b20f-95d9a99d4479 None None] PATH_INFO: `/v3` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:33:53.811091 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 729/1452] 10.222.0.36 () {54 vars in 926 bytes} [Sun Aug 29 14:33:53 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:33:53.901736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b2da-ba65-467f-b936-3e7a23966a96 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:33:53.902301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b2da-ba65-467f-b936-3e7a23966a96 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:33:53.902408 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b2da-ba65-467f-b936-3e7a23966a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:33:53.920739 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-fbf5b2da-ba65-467f-b936-3e7a23966a96 None None] MFA Rules not processed for user `b77a408df11844e2aacbb366019dc3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:33:53.921970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-fbf5b2da-ba65-467f-b936-3e7a23966a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:33:53.986651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 724/1453] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 29 14:33:53 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:33:54.005546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4b97b-ae21-4b0a-928b-8a3b7a8347ba None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:33:54.005883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4b97b-ae21-4b0a-928b-8a3b7a8347ba None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:33:54.006159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4b97b-ae21-4b0a-928b-8a3b7a8347ba None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:33:54.007916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 730/1454] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 29 14:33:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:33:54.013112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377e839-3a45-4b85-b22e-84b143c8d9d2 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:33:54.013395 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377e839-3a45-4b85-b22e-84b143c8d9d2 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:33:54.013667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377e839-3a45-4b85-b22e-84b143c8d9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:33:54.031530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e377e839-3a45-4b85-b22e-84b143c8d9d2 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:33:54.032715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e377e839-3a45-4b85-b22e-84b143c8d9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:33:54.086633 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 725/1455] 127.0.0.1 () {58 vars in 999 bytes} [Sun Aug 29 14:33:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:33:54.241588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4b97b-ae21-4b0a-928b-8a3b7a8347ba None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:33:54.243296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-06c4b97b-ae21-4b0a-928b-8a3b7a8347ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:33:54.313534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4b97b-ae21-4b0a-928b-8a3b7a8347ba None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:33:54.319052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133b93d-2ab7-43c6-9b3d-50e5a219d71e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:33:54.319687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133b93d-2ab7-43c6-9b3d-50e5a219d71e service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:33:54.319968 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133b93d-2ab7-43c6-9b3d-50e5a219d71e service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:33:54.320241 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133b93d-2ab7-43c6-9b3d-50e5a219d71e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:33:54.328724 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133b93d-2ab7-43c6-9b3d-50e5a219d71e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:33:54.330341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133b93d-2ab7-43c6-9b3d-50e5a219d71e service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:33:54.340061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 731/1456] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:33:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:33:55.709798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de259a9-c0ae-4d57-a3d2-e4f8a3e4eb90 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:33:55.710406 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de259a9-c0ae-4d57-a3d2-e4f8a3e4eb90 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:33:55.710406 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de259a9-c0ae-4d57-a3d2-e4f8a3e4eb90 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:33:55.712145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 726/1457] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 29 14:33:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:33:55.717903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63283-60e1-45cb-9680-3802f29e7de8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:33:55.718331 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63283-60e1-45cb-9680-3802f29e7de8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:33:55.718468 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63283-60e1-45cb-9680-3802f29e7de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:33:55.738902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-37b63283-60e1-45cb-9680-3802f29e7de8 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:33:55.740097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-37b63283-60e1-45cb-9680-3802f29e7de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:33:55.748384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 732/1458] 127.0.0.1 () {58 vars in 999 bytes} [Sun Aug 29 14:33:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:33:55.902290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de259a9-c0ae-4d57-a3d2-e4f8a3e4eb90 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:33:55.917329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de259a9-c0ae-4d57-a3d2-e4f8a3e4eb90 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:33:55.922792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68150b9-cb08-4448-907d-8ff0aae13a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:33:55.923438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68150b9-cb08-4448-907d-8ff0aae13a4a service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:33:55.923701 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68150b9-cb08-4448-907d-8ff0aae13a4a service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:33:55.923974 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68150b9-cb08-4448-907d-8ff0aae13a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:33:55.933158 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68150b9-cb08-4448-907d-8ff0aae13a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:33:55.934776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68150b9-cb08-4448-907d-8ff0aae13a4a service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:33:55.944178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 727/1459] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:33:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:34:02.414975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719d80e-c47a-40a0-9a80-63044ecc7458 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:02.415414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719d80e-c47a-40a0-9a80-63044ecc7458 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:02.415526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719d80e-c47a-40a0-9a80-63044ecc7458 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:02.417283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 733/1460] 10.222.0.16 () {54 vars in 960 bytes} [Sun Aug 29 14:34:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:34:02.423324 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319ea3f-5462-49df-b043-0822833c69f9 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:02.423769 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319ea3f-5462-49df-b043-0822833c69f9 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:02.423867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319ea3f-5462-49df-b043-0822833c69f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:02.442353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f319ea3f-5462-49df-b043-0822833c69f9 None None] MFA Rules not processed for user `b77a408df11844e2aacbb366019dc3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:34:02.443540 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f319ea3f-5462-49df-b043-0822833c69f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:34:02.451847 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 728/1461] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Aug 29 14:34:02 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:34:02.459578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719d80e-c47a-40a0-9a80-63044ecc7458 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:34:02.473081 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719d80e-c47a-40a0-9a80-63044ecc7458 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:34:02.478075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a6556-a20a-47a6-94ee-6ea282f14cea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77a408df11844e2aacbb366019dc3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:34:02.478692 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a6556-a20a-47a6-94ee-6ea282f14cea service placement] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:02.478973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a6556-a20a-47a6-94ee-6ea282f14cea service placement] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:02.479240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a6556-a20a-47a6-94ee-6ea282f14cea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:02.488487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a6556-a20a-47a6-94ee-6ea282f14cea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:34:02.490124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a6556-a20a-47a6-94ee-6ea282f14cea service placement] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:34:02.500394 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 734/1462] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:34:02 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:34:07.710064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ba6e-3c70-48af-b3f8-cd5ea633b7ae None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:07.710632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ba6e-3c70-48af-b3f8-cd5ea633b7ae None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:07.710632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ba6e-3c70-48af-b3f8-cd5ea633b7ae None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:07.712354 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 729/1463] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 29 14:34:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:34:07.717596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e18eb8-1a00-4ceb-bae5-79e9aad8c53f None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:07.718066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e18eb8-1a00-4ceb-bae5-79e9aad8c53f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:07.718174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e18eb8-1a00-4ceb-bae5-79e9aad8c53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:07.736290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d4e18eb8-1a00-4ceb-bae5-79e9aad8c53f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:34:07.737490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d4e18eb8-1a00-4ceb-bae5-79e9aad8c53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:34:07.745125 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 735/1464] 127.0.0.1 () {58 vars in 999 bytes} [Sun Aug 29 14:34:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:34:07.900265 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ba6e-3c70-48af-b3f8-cd5ea633b7ae None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:34:07.914536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ba6e-3c70-48af-b3f8-cd5ea633b7ae None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:34:07.919901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163e2b1-d0a7-4aa6-b8df-494fabb3bb40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:34:07.920705 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163e2b1-d0a7-4aa6-b8df-494fabb3bb40 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:07.920982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163e2b1-d0a7-4aa6-b8df-494fabb3bb40 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:07.921252 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163e2b1-d0a7-4aa6-b8df-494fabb3bb40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:07.929127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163e2b1-d0a7-4aa6-b8df-494fabb3bb40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:34:07.930732 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163e2b1-d0a7-4aa6-b8df-494fabb3bb40 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:34:07.940748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 730/1465] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:34:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:34:09.305801 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b5c9-bc81-4ea8-8794-91201d941c61 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:09.306371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b5c9-bc81-4ea8-8794-91201d941c61 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:09.306371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b5c9-bc81-4ea8-8794-91201d941c61 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:09.308148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 736/1466] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 29 14:34:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:34:09.314248 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1832e7-9eda-4006-9c17-a145985bf55a None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:09.314631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1832e7-9eda-4006-9c17-a145985bf55a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:09.314795 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1832e7-9eda-4006-9c17-a145985bf55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:09.332252 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-7b1832e7-9eda-4006-9c17-a145985bf55a None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:34:09.333428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7b1832e7-9eda-4006-9c17-a145985bf55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:34:09.340993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 731/1467] 127.0.0.1 () {58 vars in 999 bytes} [Sun Aug 29 14:34:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:34:09.495285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b5c9-bc81-4ea8-8794-91201d941c61 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:34:09.509568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b5c9-bc81-4ea8-8794-91201d941c61 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:34:09.515739 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdbf74-095f-4658-be88-5406dc50bc26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:34:09.516414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdbf74-095f-4658-be88-5406dc50bc26 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:09.516694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdbf74-095f-4658-be88-5406dc50bc26 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:09.516967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdbf74-095f-4658-be88-5406dc50bc26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:09.525014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdbf74-095f-4658-be88-5406dc50bc26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:34:09.526676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdbf74-095f-4658-be88-5406dc50bc26 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:34:09.536362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 737/1468] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:34:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:34:13.560246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744e650-4710-406b-98c5-cf58b418366b None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:13.561045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744e650-4710-406b-98c5-cf58b418366b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:13.561045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744e650-4710-406b-98c5-cf58b418366b None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:13.562509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 732/1469] 127.0.0.1 () {54 vars in 916 bytes} [Sun Aug 29 14:34:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:34:13.568215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a097d2-865d-416a-b489-ee731b7fc9a5 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:13.568617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a097d2-865d-416a-b489-ee731b7fc9a5 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:13.568800 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a097d2-865d-416a-b489-ee731b7fc9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:13.587001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-52a097d2-865d-416a-b489-ee731b7fc9a5 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:34:13.588184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-52a097d2-865d-416a-b489-ee731b7fc9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:34:13.597274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 738/1470] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 29 14:34:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:34:13.640825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744e650-4710-406b-98c5-cf58b418366b None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:34:13.642530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-9744e650-4710-406b-98c5-cf58b418366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:34:13.697309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744e650-4710-406b-98c5-cf58b418366b None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:34:13.700803 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a48f7-8c02-46fd-b4b2-a56c45e82c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:34:13.701653 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a48f7-8c02-46fd-b4b2-a56c45e82c49 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:13.701956 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a48f7-8c02-46fd-b4b2-a56c45e82c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:13.702234 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a48f7-8c02-46fd-b4b2-a56c45e82c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:13.710733 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a48f7-8c02-46fd-b4b2-a56c45e82c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:34:13.712142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a48f7-8c02-46fd-b4b2-a56c45e82c49 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:34:13.721316 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 733/1471] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:34:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:34:15.866851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4811ba-049f-4fb3-b69e-521bedd67059 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:15.867415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4811ba-049f-4fb3-b69e-521bedd67059 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:15.867415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4811ba-049f-4fb3-b69e-521bedd67059 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:15.869159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 739/1472] 127.0.0.1 () {54 vars in 916 bytes} [Sun Aug 29 14:34:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:34:15.874853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd5c5-df71-4037-aeac-5cb7b4fb3d00 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:15.875247 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd5c5-df71-4037-aeac-5cb7b4fb3d00 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:15.875405 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd5c5-df71-4037-aeac-5cb7b4fb3d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:15.893393 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-1c2fd5c5-df71-4037-aeac-5cb7b4fb3d00 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:34:15.894620 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1c2fd5c5-df71-4037-aeac-5cb7b4fb3d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:34:15.902223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 734/1473] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 29 14:34:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:34:15.939375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4811ba-049f-4fb3-b69e-521bedd67059 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:34:15.941153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ab4811ba-049f-4fb3-b69e-521bedd67059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:34:15.954488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4811ba-049f-4fb3-b69e-521bedd67059 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:34:15.958054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4305c-e44d-4037-af11-fd070c587959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:34:15.958694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4305c-e44d-4037-af11-fd070c587959 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:15.958975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4305c-e44d-4037-af11-fd070c587959 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:15.959277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4305c-e44d-4037-af11-fd070c587959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:15.968971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4305c-e44d-4037-af11-fd070c587959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:34:15.970417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4305c-e44d-4037-af11-fd070c587959 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:34:15.979459 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 740/1474] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:34:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:34:19.558246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfbe3e-c776-45c0-8896-83761c17b436 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:19.558793 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfbe3e-c776-45c0-8896-83761c17b436 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:19.558793 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfbe3e-c776-45c0-8896-83761c17b436 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:19.560594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 735/1475] 127.0.0.1 () {54 vars in 916 bytes} [Sun Aug 29 14:34:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:34:19.567020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c5bb9-c19f-4744-a67d-8e2ac760e353 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:19.567428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c5bb9-c19f-4744-a67d-8e2ac760e353 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:19.567586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c5bb9-c19f-4744-a67d-8e2ac760e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:19.585244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-945c5bb9-c19f-4744-a67d-8e2ac760e353 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:34:19.586507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-945c5bb9-c19f-4744-a67d-8e2ac760e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:34:19.594219 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 741/1476] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 29 14:34:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:34:19.648578 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfbe3e-c776-45c0-8896-83761c17b436 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:34:19.650249 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e3dfbe3e-c776-45c0-8896-83761c17b436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:34:19.705354 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfbe3e-c776-45c0-8896-83761c17b436 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:34:19.708851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567277f-5eaa-40cf-b29f-4ec13715b203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:34:19.709482 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567277f-5eaa-40cf-b29f-4ec13715b203 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:19.709763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567277f-5eaa-40cf-b29f-4ec13715b203 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:19.710066 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567277f-5eaa-40cf-b29f-4ec13715b203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:19.718676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567277f-5eaa-40cf-b29f-4ec13715b203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:34:19.720091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567277f-5eaa-40cf-b29f-4ec13715b203 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:34:19.729110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 736/1477] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:34:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:34:21.983587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b06a5d-5d8d-486a-abc5-dece4391a09a None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:21.984084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b06a5d-5d8d-486a-abc5-dece4391a09a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:21.984179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b06a5d-5d8d-486a-abc5-dece4391a09a None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:21.985991 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 742/1478] 127.0.0.1 () {54 vars in 916 bytes} [Sun Aug 29 14:34:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:34:21.993114 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eb402-51f5-4b8e-ad6f-65b8d13cbf35 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:21.993543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eb402-51f5-4b8e-ad6f-65b8d13cbf35 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:21.993645 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eb402-51f5-4b8e-ad6f-65b8d13cbf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:22.012701 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-831eb402-51f5-4b8e-ad6f-65b8d13cbf35 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:34:22.014459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-831eb402-51f5-4b8e-ad6f-65b8d13cbf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:34:22.021986 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 737/1479] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 29 14:34:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:34:22.074389 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dab7e-2d76-47b0-bc38-2973196922ca None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:22.074671 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dab7e-2d76-47b0-bc38-2973196922ca None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:22.074973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dab7e-2d76-47b0-bc38-2973196922ca None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:22.077321 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 743/1480] 10.222.0.16 () {54 vars in 966 bytes} [Sun Aug 29 14:34:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:34:22.082554 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaf02e-4352-48cb-ab38-92a1721e3d69 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:22.082844 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaf02e-4352-48cb-ab38-92a1721e3d69 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:22.083119 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaf02e-4352-48cb-ab38-92a1721e3d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:22.101560 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-ccbaf02e-4352-48cb-ab38-92a1721e3d69 None None] MFA Rules not processed for user `9ca81ff9c3114e8c9379418956063bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:34:22.102776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ccbaf02e-4352-48cb-ab38-92a1721e3d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:34:22.109480 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 738/1481] 10.222.0.16 () {58 vars in 1064 bytes} [Sun Aug 29 14:34:22 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:34:22.117332 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dab7e-2d76-47b0-bc38-2973196922ca None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:34:22.128369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dab7e-2d76-47b0-bc38-2973196922ca None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:34:22.131871 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa4fea-9349-4d0c-b6b3-a7a3100fb0d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:34:22.132490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa4fea-9349-4d0c-b6b3-a7a3100fb0d8 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:34:22.132767 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa4fea-9349-4d0c-b6b3-a7a3100fb0d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:34:22.133044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa4fea-9349-4d0c-b6b3-a7a3100fb0d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:34:22.142706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa4fea-9349-4d0c-b6b3-a7a3100fb0d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:34:22.144126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa4fea-9349-4d0c-b6b3-a7a3100fb0d8 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:34:22.153049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 744/1482] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:34:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:35:41.116453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496098f8-77bc-436b-bf82-56c7fcc52be1 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.117383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496098f8-77bc-436b-bf82-56c7fcc52be1 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.117895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496098f8-77bc-436b-bf82-56c7fcc52be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.146903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-496098f8-77bc-436b-bf82-56c7fcc52be1 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:41.148458 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-496098f8-77bc-436b-bf82-56c7fcc52be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:41.157442 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 739/1483] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:41.166157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aabdbd-c6c9-46f8-9e20-6f4efa535465 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.167050 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aabdbd-c6c9-46f8-9e20-6f4efa535465 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.167526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aabdbd-c6c9-46f8-9e20-6f4efa535465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.189926 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-23aabdbd-c6c9-46f8-9e20-6f4efa535465 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:41.191558 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-23aabdbd-c6c9-46f8-9e20-6f4efa535465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:41.205388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 745/1484] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:41.210323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496098f8-77bc-436b-bf82-56c7fcc52be1 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:41.223010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496098f8-77bc-436b-bf82-56c7fcc52be1 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:41.231223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbf827-0d2f-47c4-93ab-640dbd25f809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:41.232237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbf827-0d2f-47c4-93ab-640dbd25f809 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.232707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbf827-0d2f-47c4-93ab-640dbd25f809 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.233173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbf827-0d2f-47c4-93ab-640dbd25f809 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.234117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbf827-0d2f-47c4-93ab-640dbd25f809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:35:41.234619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbf827-0d2f-47c4-93ab-640dbd25f809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:41.236390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbf827-0d2f-47c4-93ab-640dbd25f809 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:41.252507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 740/1485] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:35:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:35:41.261649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aabdbd-c6c9-46f8-9e20-6f4efa535465 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:41.274422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aabdbd-c6c9-46f8-9e20-6f4efa535465 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:41.280143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6677290-5e60-424e-83ef-08d1ffb3d97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:41.281045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6677290-5e60-424e-83ef-08d1ffb3d97b admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.281520 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6677290-5e60-424e-83ef-08d1ffb3d97b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.282010 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6677290-5e60-424e-83ef-08d1ffb3d97b admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.283033 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6677290-5e60-424e-83ef-08d1ffb3d97b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:41.285120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6677290-5e60-424e-83ef-08d1ffb3d97b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:41.321548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09087d81-93d9-45a4-966a-5f460fbb9028 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.322188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09087d81-93d9-45a4-966a-5f460fbb9028 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.322874 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09087d81-93d9-45a4-966a-5f460fbb9028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.350202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-09087d81-93d9-45a4-966a-5f460fbb9028 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:41.351763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-09087d81-93d9-45a4-966a-5f460fbb9028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:41.361584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 741/1486] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:41.363240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c075b-8bf9-4601-b296-726a982768c9 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.363729 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c075b-8bf9-4601-b296-726a982768c9 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.364322 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c075b-8bf9-4601-b296-726a982768c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.389597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-1f9c075b-8bf9-4601-b296-726a982768c9 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:41.391117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1f9c075b-8bf9-4601-b296-726a982768c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:41.403559 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 742/1487] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:41.405246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a9766-ab59-463f-b925-7ec13a8d265d None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.405736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a9766-ab59-463f-b925-7ec13a8d265d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.406232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a9766-ab59-463f-b925-7ec13a8d265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.421954 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 746/1488] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:35:41.423623 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc6e72-c888-4484-9ece-b722ce279ed6 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.424095 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc6e72-c888-4484-9ece-b722ce279ed6 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.424569 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc6e72-c888-4484-9ece-b722ce279ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.456440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-133a9766-ab59-463f-b925-7ec13a8d265d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:41.459110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-133a9766-ab59-463f-b925-7ec13a8d265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:41.472813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-07fc6e72-c888-4484-9ece-b722ce279ed6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:41.477059 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-07fc6e72-c888-4484-9ece-b722ce279ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:41.584627 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 743/1489] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:41.585577 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a9766-ab59-463f-b925-7ec13a8d265d None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:41.598971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 747/1490] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:41.602362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc6e72-c888-4484-9ece-b722ce279ed6 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:41.603066 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a9766-ab59-463f-b925-7ec13a8d265d None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:41.623820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc6e72-c888-4484-9ece-b722ce279ed6 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:41.625052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea362dc-8952-4d8d-bdd0-57a9e19efd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:41.625735 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea362dc-8952-4d8d-bdd0-57a9e19efd31 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.626047 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea362dc-8952-4d8d-bdd0-57a9e19efd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.626305 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea362dc-8952-4d8d-bdd0-57a9e19efd31 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.626998 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea362dc-8952-4d8d-bdd0-57a9e19efd31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:41.629231 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea362dc-8952-4d8d-bdd0-57a9e19efd31 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:41.645735 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea1a44-7c05-4479-a624-1f1939bdb23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:41.646439 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea1a44-7c05-4479-a624-1f1939bdb23f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.646720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea1a44-7c05-4479-a624-1f1939bdb23f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.646991 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea1a44-7c05-4479-a624-1f1939bdb23f admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.647714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea1a44-7c05-4479-a624-1f1939bdb23f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:35:41.648320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea1a44-7c05-4479-a624-1f1939bdb23f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:41.652136 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea1a44-7c05-4479-a624-1f1939bdb23f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:41.675004 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 748/1491] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:35:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:35:41.676678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06b73f-d8d0-468f-a732-d11f846b9152 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.677180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06b73f-d8d0-468f-a732-d11f846b9152 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.677668 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06b73f-d8d0-468f-a732-d11f846b9152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.703760 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-8c06b73f-d8d0-468f-a732-d11f846b9152 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:41.705271 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8c06b73f-d8d0-468f-a732-d11f846b9152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:41.717432 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 749/1492] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:41.718621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06b73f-d8d0-468f-a732-d11f846b9152 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:41.737549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06b73f-d8d0-468f-a732-d11f846b9152 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:41.739814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 744/1493] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:41.740609 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea362dc-8952-4d8d-bdd0-57a9e19efd31 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:41.750941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc864b3-3fb9-48b3-b2bf-23dde1b7289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:41.751842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc864b3-3fb9-48b3-b2bf-23dde1b7289f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.752125 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc864b3-3fb9-48b3-b2bf-23dde1b7289f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.752395 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc864b3-3fb9-48b3-b2bf-23dde1b7289f admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.753109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc864b3-3fb9-48b3-b2bf-23dde1b7289f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:35:41.753545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc864b3-3fb9-48b3-b2bf-23dde1b7289f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:41.755424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc864b3-3fb9-48b3-b2bf-23dde1b7289f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:41.761961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea362dc-8952-4d8d-bdd0-57a9e19efd31 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:41.771462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9f11-4461-4f2a-babd-6803117affa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:41.772183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9f11-4461-4f2a-babd-6803117affa6 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.772471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9f11-4461-4f2a-babd-6803117affa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.772748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9f11-4461-4f2a-babd-6803117affa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.773098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 750/1494] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:35:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:35:41.773498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac9f11-4461-4f2a-babd-6803117affa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:41.774685 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3eb4ae-64f5-4cd7-808a-4f6ab6721c04 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.774973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3eb4ae-64f5-4cd7-808a-4f6ab6721c04 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.775242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3eb4ae-64f5-4cd7-808a-4f6ab6721c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.777243 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac9f11-4461-4f2a-babd-6803117affa6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:41.803218 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0d3eb4ae-64f5-4cd7-808a-4f6ab6721c04 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:41.804430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0d3eb4ae-64f5-4cd7-808a-4f6ab6721c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:41.812797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 751/1495] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:41.814092 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d74b-64ea-4d8e-bf8a-ac28d472a94f None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.814378 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d74b-64ea-4d8e-bf8a-ac28d472a94f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.814654 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d74b-64ea-4d8e-bf8a-ac28d472a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.834629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-dd03d74b-64ea-4d8e-bf8a-ac28d472a94f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:41.835802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-dd03d74b-64ea-4d8e-bf8a-ac28d472a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:41.844319 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 752/1496] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:41.845091 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03d74b-64ea-4d8e-bf8a-ac28d472a94f None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:41.858821 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03d74b-64ea-4d8e-bf8a-ac28d472a94f None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:41.863591 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428832e4-9677-4bdc-9696-4d237e338b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:41.864245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428832e4-9677-4bdc-9696-4d237e338b63 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.864525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428832e4-9677-4bdc-9696-4d237e338b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.864817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428832e4-9677-4bdc-9696-4d237e338b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.865605 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428832e4-9677-4bdc-9696-4d237e338b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:41.867268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428832e4-9677-4bdc-9696-4d237e338b63 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:41.877411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 753/1497] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:41.878784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8efade-b482-422e-be92-6f1a73a7407f None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.879076 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8efade-b482-422e-be92-6f1a73a7407f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.879356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8efade-b482-422e-be92-6f1a73a7407f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.891917 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 745/1498] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:41.891917 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9f11-4461-4f2a-babd-6803117affa6 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:41.897480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-8e8efade-b482-422e-be92-6f1a73a7407f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:41.898701 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8e8efade-b482-422e-be92-6f1a73a7407f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:41.954136 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9f11-4461-4f2a-babd-6803117affa6 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:41.958895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07782f6f-de38-4139-84fa-1e313eba72cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:41.959551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07782f6f-de38-4139-84fa-1e313eba72cc admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.959825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07782f6f-de38-4139-84fa-1e313eba72cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.960090 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07782f6f-de38-4139-84fa-1e313eba72cc admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.960795 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07782f6f-de38-4139-84fa-1e313eba72cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:41.962703 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07782f6f-de38-4139-84fa-1e313eba72cc admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:41.969918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 754/1499] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:41.969918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61f4a-26a6-4a74-9a2f-8328091bce4a None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.969918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61f4a-26a6-4a74-9a2f-8328091bce4a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.969918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61f4a-26a6-4a74-9a2f-8328091bce4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:41.985259 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-fcc61f4a-26a6-4a74-9a2f-8328091bce4a None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:41.992665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-fcc61f4a-26a6-4a74-9a2f-8328091bce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:41.994786 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 755/1500] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:41.996010 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9532b93-3ff5-4450-9bda-8e2dc9d5b31a None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:41.996298 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9532b93-3ff5-4450-9bda-8e2dc9d5b31a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:41.996578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9532b93-3ff5-4450-9bda-8e2dc9d5b31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.014596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-e9532b93-3ff5-4450-9bda-8e2dc9d5b31a None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:42.015757 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e9532b93-3ff5-4450-9bda-8e2dc9d5b31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:42.023559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 756/1501] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:42.024317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9532b93-3ff5-4450-9bda-8e2dc9d5b31a None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.034207 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9532b93-3ff5-4450-9bda-8e2dc9d5b31a None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.038725 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc50eb0-e67c-4f03-a55a-e19978c852a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.039345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc50eb0-e67c-4f03-a55a-e19978c852a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.039625 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc50eb0-e67c-4f03-a55a-e19978c852a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.039904 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc50eb0-e67c-4f03-a55a-e19978c852a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.040640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc50eb0-e67c-4f03-a55a-e19978c852a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:35:42.040938 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc50eb0-e67c-4f03-a55a-e19978c852a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.042643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc50eb0-e67c-4f03-a55a-e19978c852a7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.053465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 757/1502] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:35:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:35:42.054643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832376-97a5-497a-8629-6672b7afadec None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.054923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832376-97a5-497a-8629-6672b7afadec None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.055194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832376-97a5-497a-8629-6672b7afadec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.073570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-13832376-97a5-497a-8629-6672b7afadec None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:42.080377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-13832376-97a5-497a-8629-6672b7afadec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:42.080493 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 746/1503] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:35:41 2021] POST /identity/v3/projects => generated 393 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:42.080493 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07782f6f-de38-4139-84fa-1e313eba72cc admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.131631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 758/1504] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:42.132447 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13832376-97a5-497a-8629-6672b7afadec None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.140401 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07782f6f-de38-4139-84fa-1e313eba72cc admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.141981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13832376-97a5-497a-8629-6672b7afadec None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.145086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf0607-0814-41ff-8775-0d35c059e614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.145749 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0607-0814-41ff-8775-0d35c059e614 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.146071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0607-0814-41ff-8775-0d35c059e614 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.146351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0607-0814-41ff-8775-0d35c059e614 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.146528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed6dd8-c0aa-4f90-8d81-0db569d8c40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.147075 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf0607-0814-41ff-8775-0d35c059e614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.147194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed6dd8-c0aa-4f90-8d81-0db569d8c40c admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.147420 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed6dd8-c0aa-4f90-8d81-0db569d8c40c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.147689 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed6dd8-c0aa-4f90-8d81-0db569d8c40c admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.148358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed6dd8-c0aa-4f90-8d81-0db569d8c40c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.148724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf0607-0814-41ff-8775-0d35c059e614 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.150312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed6dd8-c0aa-4f90-8d81-0db569d8c40c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.159604 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 747/1505] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:42 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:42.160951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba883-2f0f-4836-ac17-0cf3cbf31274 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.161246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba883-2f0f-4836-ac17-0cf3cbf31274 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.161526 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba883-2f0f-4836-ac17-0cf3cbf31274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.179507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-256ba883-2f0f-4836-ac17-0cf3cbf31274 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:42.180704 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-256ba883-2f0f-4836-ac17-0cf3cbf31274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:42.188495 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 748/1506] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:42.189717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9c6fa-69ce-467e-afae-c84a82d56ed5 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.190037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9c6fa-69ce-467e-afae-c84a82d56ed5 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.190310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9c6fa-69ce-467e-afae-c84a82d56ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.207348 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-95d9c6fa-69ce-467e-afae-c84a82d56ed5 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:42.208489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-95d9c6fa-69ce-467e-afae-c84a82d56ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:42.216595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 749/1507] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:42.217329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9c6fa-69ce-467e-afae-c84a82d56ed5 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.225885 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9c6fa-69ce-467e-afae-c84a82d56ed5 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.230758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bc36a-80b4-4b63-80c9-6272e442bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.231363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bc36a-80b4-4b63-80c9-6272e442bdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.231640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bc36a-80b4-4b63-80c9-6272e442bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.231910 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bc36a-80b4-4b63-80c9-6272e442bdb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.232594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bc36a-80b4-4b63-80c9-6272e442bdb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:35:42.232897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bc36a-80b4-4b63-80c9-6272e442bdb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.234483 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bc36a-80b4-4b63-80c9-6272e442bdb5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.243532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 759/1508] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:42.243532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed6dd8-c0aa-4f90-8d81-0db569d8c40c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.249657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 750/1509] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:35:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:35:42.250487 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bc36a-80b4-4b63-80c9-6272e442bdb5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.251165 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed6dd8-c0aa-4f90-8d81-0db569d8c40c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.255889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e458d87-549b-460d-9f63-31b2e6ea536f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.256589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e458d87-549b-460d-9f63-31b2e6ea536f admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.257329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e458d87-549b-460d-9f63-31b2e6ea536f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.257598 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e458d87-549b-460d-9f63-31b2e6ea536f admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.258313 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e458d87-549b-460d-9f63-31b2e6ea536f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.260410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bc36a-80b4-4b63-80c9-6272e442bdb5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.260717 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e458d87-549b-460d-9f63-31b2e6ea536f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.265001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546335e9-cba8-4f77-97e0-7acc698ff230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.268002 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546335e9-cba8-4f77-97e0-7acc698ff230 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.268002 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546335e9-cba8-4f77-97e0-7acc698ff230 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.268002 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546335e9-cba8-4f77-97e0-7acc698ff230 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.268002 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546335e9-cba8-4f77-97e0-7acc698ff230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.268693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546335e9-cba8-4f77-97e0-7acc698ff230 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.349683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 760/1510] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:42.351077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f0db2-e47a-402e-a197-d42ade9ca81e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.351475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f0db2-e47a-402e-a197-d42ade9ca81e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.351756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f0db2-e47a-402e-a197-d42ade9ca81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.364534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 751/1511] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:42.364534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546335e9-cba8-4f77-97e0-7acc698ff230 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.371054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-8b3f0db2-e47a-402e-a197-d42ade9ca81e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:42.372299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8b3f0db2-e47a-402e-a197-d42ade9ca81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:42.372537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546335e9-cba8-4f77-97e0-7acc698ff230 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.428528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7534ac-cfb7-4e54-a947-a82b8f6997bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.429423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7534ac-cfb7-4e54-a947-a82b8f6997bd admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.429702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7534ac-cfb7-4e54-a947-a82b8f6997bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.430011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7534ac-cfb7-4e54-a947-a82b8f6997bd admin admin] PATH_INFO: `/v3/projects/f47de2d93f9f4dccbc3c75e56e117b44/users/569387965b184cc3a1bc2aecdbede0cb/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.431251 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 761/1512] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:42.432657 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f0db2-e47a-402e-a197-d42ade9ca81e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.441984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f0db2-e47a-402e-a197-d42ade9ca81e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.444978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7534ac-cfb7-4e54-a947-a82b8f6997bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47de2d93f9f4dccbc3c75e56e117b44, user_id=569387965b184cc3a1bc2aecdbede0cb, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.446753 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bfdf8-ef0a-4130-8f62-f37ccb6384f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.448327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bfdf8-ef0a-4130-8f62-f37ccb6384f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.448614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7534ac-cfb7-4e54-a947-a82b8f6997bd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.448723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bfdf8-ef0a-4130-8f62-f37ccb6384f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.448981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bfdf8-ef0a-4130-8f62-f37ccb6384f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.449706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bfdf8-ef0a-4130-8f62-f37ccb6384f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:35:42.450058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bfdf8-ef0a-4130-8f62-f37ccb6384f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.451662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bfdf8-ef0a-4130-8f62-f37ccb6384f0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.463255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 762/1513] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:35:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:35:42.464138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bfdf8-ef0a-4130-8f62-f37ccb6384f0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.473148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bfdf8-ef0a-4130-8f62-f37ccb6384f0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.477933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98727d-1bf4-4fdf-8f8f-654e4ed51031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.478556 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98727d-1bf4-4fdf-8f8f-654e4ed51031 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.479019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98727d-1bf4-4fdf-8f8f-654e4ed51031 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.479293 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98727d-1bf4-4fdf-8f8f-654e4ed51031 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.480067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98727d-1bf4-4fdf-8f8f-654e4ed51031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:35:42.480290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98727d-1bf4-4fdf-8f8f-654e4ed51031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.481849 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98727d-1bf4-4fdf-8f8f-654e4ed51031 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.493098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 763/1514] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:35:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:35:42.495244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98727d-1bf4-4fdf-8f8f-654e4ed51031 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.503876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98727d-1bf4-4fdf-8f8f-654e4ed51031 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.508473 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698329e-86e3-4766-abe6-8d07796690c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.509096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698329e-86e3-4766-abe6-8d07796690c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.509376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698329e-86e3-4766-abe6-8d07796690c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.509648 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698329e-86e3-4766-abe6-8d07796690c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.511078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698329e-86e3-4766-abe6-8d07796690c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.512650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698329e-86e3-4766-abe6-8d07796690c4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.522229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 764/1515] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:42 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:42.525061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698329e-86e3-4766-abe6-8d07796690c4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.532010 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698329e-86e3-4766-abe6-8d07796690c4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.536654 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc512-d329-4cea-b1e6-04c8eee679a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.537265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc512-d329-4cea-b1e6-04c8eee679a4 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.537575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc512-d329-4cea-b1e6-04c8eee679a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.537996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc512-d329-4cea-b1e6-04c8eee679a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.538664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfc512-d329-4cea-b1e6-04c8eee679a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.540508 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfc512-d329-4cea-b1e6-04c8eee679a4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.550102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 752/1516] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:35:42 2021] PUT /identity/v3/projects/f47de2d93f9f4dccbc3c75e56e117b44/users/569387965b184cc3a1bc2aecdbede0cb/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:35:42.556323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7534ac-cfb7-4e54-a947-a82b8f6997bd admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.609618 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7534ac-cfb7-4e54-a947-a82b8f6997bd admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.614214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567afe59-68f2-4d6c-b5b1-47ee4edca5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.614866 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567afe59-68f2-4d6c-b5b1-47ee4edca5ef admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.615142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567afe59-68f2-4d6c-b5b1-47ee4edca5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.615408 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567afe59-68f2-4d6c-b5b1-47ee4edca5ef admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.616074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567afe59-68f2-4d6c-b5b1-47ee4edca5ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.618018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567afe59-68f2-4d6c-b5b1-47ee4edca5ef admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.643361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 765/1517] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:42.644225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc512-d329-4cea-b1e6-04c8eee679a4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.702707 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc512-d329-4cea-b1e6-04c8eee679a4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.707266 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811995c0-2a99-4b8b-981b-5a8cd9c0d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.707916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811995c0-2a99-4b8b-981b-5a8cd9c0d45e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.708193 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811995c0-2a99-4b8b-981b-5a8cd9c0d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.708463 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811995c0-2a99-4b8b-981b-5a8cd9c0d45e admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.709169 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811995c0-2a99-4b8b-981b-5a8cd9c0d45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.713239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 753/1518] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/users => generated 279 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:42.713388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811995c0-2a99-4b8b-981b-5a8cd9c0d45e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.713582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567afe59-68f2-4d6c-b5b1-47ee4edca5ef admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.721111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567afe59-68f2-4d6c-b5b1-47ee4edca5ef admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.722935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 766/1519] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:42 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:42.724183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811995c0-2a99-4b8b-981b-5a8cd9c0d45e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.729573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f19af-0a05-4235-b08c-10c17e0600a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.730254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f19af-0a05-4235-b08c-10c17e0600a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.730530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f19af-0a05-4235-b08c-10c17e0600a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.730798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f19af-0a05-4235-b08c-10c17e0600a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.731515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f19af-0a05-4235-b08c-10c17e0600a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:35:42.731865 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f19af-0a05-4235-b08c-10c17e0600a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.733441 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f19af-0a05-4235-b08c-10c17e0600a1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.734378 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811995c0-2a99-4b8b-981b-5a8cd9c0d45e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.739157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678b5d7-5d59-44dd-af59-d6ff223a6c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.739810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678b5d7-5d59-44dd-af59-d6ff223a6c39 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.740093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678b5d7-5d59-44dd-af59-d6ff223a6c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.740363 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678b5d7-5d59-44dd-af59-d6ff223a6c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.741200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678b5d7-5d59-44dd-af59-d6ff223a6c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.743045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678b5d7-5d59-44dd-af59-d6ff223a6c39 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.745548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 754/1520] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:35:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:35:42.746446 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f19af-0a05-4235-b08c-10c17e0600a1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.755737 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f19af-0a05-4235-b08c-10c17e0600a1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.760416 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b742e-5064-47a9-8ca2-842e5ca72dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.761043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b742e-5064-47a9-8ca2-842e5ca72dcb admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.761325 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b742e-5064-47a9-8ca2-842e5ca72dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.761593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b742e-5064-47a9-8ca2-842e5ca72dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.762292 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b742e-5064-47a9-8ca2-842e5ca72dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.764148 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b742e-5064-47a9-8ca2-842e5ca72dcb admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.859044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 767/1521] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:42.860010 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678b5d7-5d59-44dd-af59-d6ff223a6c39 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.897378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 755/1522] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:42.897378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573ac82-4123-4c19-86f7-50d89a0baba9 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.897378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573ac82-4123-4c19-86f7-50d89a0baba9 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.897378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573ac82-4123-4c19-86f7-50d89a0baba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.913228 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-4573ac82-4123-4c19-86f7-50d89a0baba9 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:42.914477 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4573ac82-4123-4c19-86f7-50d89a0baba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:42.920864 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678b5d7-5d59-44dd-af59-d6ff223a6c39 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.970426 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 756/1523] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:42.971587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573ac82-4123-4c19-86f7-50d89a0baba9 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:42.980528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901651c-24c3-4901-8b1c-5216ae69d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.981337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901651c-24c3-4901-8b1c-5216ae69d06f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.981510 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573ac82-4123-4c19-86f7-50d89a0baba9 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:42.981619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901651c-24c3-4901-8b1c-5216ae69d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.981898 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901651c-24c3-4901-8b1c-5216ae69d06f admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.982617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901651c-24c3-4901-8b1c-5216ae69d06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.984264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901651c-24c3-4901-8b1c-5216ae69d06f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.986714 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c93fb3-47fa-4dfa-919b-270e0865aed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:42.987366 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93fb3-47fa-4dfa-919b-270e0865aed0 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:42.987645 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93fb3-47fa-4dfa-919b-270e0865aed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:42.987916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93fb3-47fa-4dfa-919b-270e0865aed0 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:42.988593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c93fb3-47fa-4dfa-919b-270e0865aed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:42.990510 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c93fb3-47fa-4dfa-919b-270e0865aed0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:42.995057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 768/1524] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:42 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:42.998469 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901651c-24c3-4901-8b1c-5216ae69d06f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.007764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901651c-24c3-4901-8b1c-5216ae69d06f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.016655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def543c-9ad2-4838-82c5-1dd1148438a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.016655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def543c-9ad2-4838-82c5-1dd1148438a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.016655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def543c-9ad2-4838-82c5-1dd1148438a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.016655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def543c-9ad2-4838-82c5-1dd1148438a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.017073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def543c-9ad2-4838-82c5-1dd1148438a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.017073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def543c-9ad2-4838-82c5-1dd1148438a4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.026569 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 769/1525] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:42 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:43.027335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def543c-9ad2-4838-82c5-1dd1148438a4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.036177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def543c-9ad2-4838-82c5-1dd1148438a4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.040716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1771cd-69df-479a-b4ca-9cf689d2d2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.045380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1771cd-69df-479a-b4ca-9cf689d2d2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.045380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1771cd-69df-479a-b4ca-9cf689d2d2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.045380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1771cd-69df-479a-b4ca-9cf689d2d2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.045380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1771cd-69df-479a-b4ca-9cf689d2d2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.045380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1771cd-69df-479a-b4ca-9cf689d2d2a9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.056050 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 770/1526] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:43.057159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1771cd-69df-479a-b4ca-9cf689d2d2a9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.066194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1771cd-69df-479a-b4ca-9cf689d2d2a9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.070851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737802d0-ad5e-465a-ac55-30c42a91c4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.071445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737802d0-ad5e-465a-ac55-30c42a91c4ce admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.074086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737802d0-ad5e-465a-ac55-30c42a91c4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.074086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737802d0-ad5e-465a-ac55-30c42a91c4ce admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.074086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737802d0-ad5e-465a-ac55-30c42a91c4ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.074578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737802d0-ad5e-465a-ac55-30c42a91c4ce admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.098884 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 757/1527] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:35:42 2021] POST /identity/v3/users => generated 303 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:43.102937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c93fb3-47fa-4dfa-919b-270e0865aed0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.110149 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c93fb3-47fa-4dfa-919b-270e0865aed0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.114719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58766337-982f-40eb-877b-601624febbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.115370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58766337-982f-40eb-877b-601624febbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.115651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58766337-982f-40eb-877b-601624febbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.115924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58766337-982f-40eb-877b-601624febbf6 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.116596 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58766337-982f-40eb-877b-601624febbf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.118507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58766337-982f-40eb-877b-601624febbf6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.186291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 771/1528] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:35:43 2021] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:43.187100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737802d0-ad5e-465a-ac55-30c42a91c4ce admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.214626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 758/1529] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:35:43 2021] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:43.214626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58766337-982f-40eb-877b-601624febbf6 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.246603 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737802d0-ad5e-465a-ac55-30c42a91c4ce admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.251295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da9152-f2ad-443d-a37e-4a9347e4cc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.251889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da9152-f2ad-443d-a37e-4a9347e4cc1c admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.252170 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da9152-f2ad-443d-a37e-4a9347e4cc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.252443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da9152-f2ad-443d-a37e-4a9347e4cc1c admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.253112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da9152-f2ad-443d-a37e-4a9347e4cc1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.255037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da9152-f2ad-443d-a37e-4a9347e4cc1c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.265004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58766337-982f-40eb-877b-601624febbf6 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.317111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c1da7-2382-409a-be7e-e15d2bdc6132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.317758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c1da7-2382-409a-be7e-e15d2bdc6132 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.318082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c1da7-2382-409a-be7e-e15d2bdc6132 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.318349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c1da7-2382-409a-be7e-e15d2bdc6132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.327412 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c1da7-2382-409a-be7e-e15d2bdc6132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.328840 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c1da7-2382-409a-be7e-e15d2bdc6132 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.337239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 772/1530] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:35:43 2021] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:43.338687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da9152-f2ad-443d-a37e-4a9347e4cc1c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.339089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 759/1531] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:43.339834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c1da7-2382-409a-be7e-e15d2bdc6132 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.349945 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c1da7-2382-409a-be7e-e15d2bdc6132 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.355678 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfede41-fcc5-45e4-a15c-3f86a67982a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.356338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfede41-fcc5-45e4-a15c-3f86a67982a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.356615 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfede41-fcc5-45e4-a15c-3f86a67982a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.356889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfede41-fcc5-45e4-a15c-3f86a67982a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.357255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da9152-f2ad-443d-a37e-4a9347e4cc1c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.357651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfede41-fcc5-45e4-a15c-3f86a67982a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.359265 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfede41-fcc5-45e4-a15c-3f86a67982a1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.362221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5323342-ce11-4662-97bd-03d959b3a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.363102 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5323342-ce11-4662-97bd-03d959b3a74f admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.363385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5323342-ce11-4662-97bd-03d959b3a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.363662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5323342-ce11-4662-97bd-03d959b3a74f admin admin] PATH_INFO: `/v3/projects/49b2184f7302404ab91b419e21067663/users/c60cd9a36fad47d98458b8c0e28f3ea3/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.370157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 760/1532] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:43.372259 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfede41-fcc5-45e4-a15c-3f86a67982a1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.379056 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5323342-ce11-4662-97bd-03d959b3a74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b2184f7302404ab91b419e21067663, user_id=c60cd9a36fad47d98458b8c0e28f3ea3, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.381903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5323342-ce11-4662-97bd-03d959b3a74f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.383856 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfede41-fcc5-45e4-a15c-3f86a67982a1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.389434 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d23c8b-9463-4187-a554-ce24cb60cb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.390340 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d23c8b-9463-4187-a554-ce24cb60cb43 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.390617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d23c8b-9463-4187-a554-ce24cb60cb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.390889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d23c8b-9463-4187-a554-ce24cb60cb43 admin admin] PATH_INFO: `/v3/projects/cb6738c758b44604a7eb98cf8f592891/users/f44dac86674e41b78375a51798ea0cc7/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.405096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d23c8b-9463-4187-a554-ce24cb60cb43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6738c758b44604a7eb98cf8f592891, user_id=f44dac86674e41b78375a51798ea0cc7, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.411896 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d23c8b-9463-4187-a554-ce24cb60cb43 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.465157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 773/1533] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:35:43 2021] PUT /identity/v3/projects/49b2184f7302404ab91b419e21067663/users/c60cd9a36fad47d98458b8c0e28f3ea3/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:35:43.466039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5323342-ce11-4662-97bd-03d959b3a74f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.511484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 761/1534] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:35:43 2021] PUT /identity/v3/projects/cb6738c758b44604a7eb98cf8f592891/users/f44dac86674e41b78375a51798ea0cc7/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:35:43.515902 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d23c8b-9463-4187-a554-ce24cb60cb43 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.533736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5323342-ce11-4662-97bd-03d959b3a74f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.580087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d23c8b-9463-4187-a554-ce24cb60cb43 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.585636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c1795-e273-40a8-854b-8d726c4044dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.586460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c1795-e273-40a8-854b-8d726c4044dd admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.586630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c1795-e273-40a8-854b-8d726c4044dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.586905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c1795-e273-40a8-854b-8d726c4044dd admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.587580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c1795-e273-40a8-854b-8d726c4044dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.589689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c1795-e273-40a8-854b-8d726c4044dd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.593061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7fca1-2eaa-4450-a128-11ab40d7a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.593842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7fca1-2eaa-4450-a128-11ab40d7a9ac admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.594216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7fca1-2eaa-4450-a128-11ab40d7a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.594559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7fca1-2eaa-4450-a128-11ab40d7a9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.595351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7fca1-2eaa-4450-a128-11ab40d7a9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.597007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7fca1-2eaa-4450-a128-11ab40d7a9ac admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.608486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 774/1535] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:43.609263 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7fca1-2eaa-4450-a128-11ab40d7a9ac admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.618596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7fca1-2eaa-4450-a128-11ab40d7a9ac admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.624295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2a2ff-2d87-40d1-9db9-8f5a03a4fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.624946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2a2ff-2d87-40d1-9db9-8f5a03a4fb5f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.625278 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2a2ff-2d87-40d1-9db9-8f5a03a4fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.625533 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2a2ff-2d87-40d1-9db9-8f5a03a4fb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.626282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2a2ff-2d87-40d1-9db9-8f5a03a4fb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.627859 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2a2ff-2d87-40d1-9db9-8f5a03a4fb5f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.637607 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 775/1536] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:43.638448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2a2ff-2d87-40d1-9db9-8f5a03a4fb5f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.647536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2a2ff-2d87-40d1-9db9-8f5a03a4fb5f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.652327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb6652-259c-4305-b015-0f30d9ddd82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.652941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb6652-259c-4305-b015-0f30d9ddd82f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.653221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb6652-259c-4305-b015-0f30d9ddd82f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.653490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb6652-259c-4305-b015-0f30d9ddd82f admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.654213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb6652-259c-4305-b015-0f30d9ddd82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.655763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb6652-259c-4305-b015-0f30d9ddd82f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.665068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 776/1537] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:43.665798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb6652-259c-4305-b015-0f30d9ddd82f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.675454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb6652-259c-4305-b015-0f30d9ddd82f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.680018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0196a1d-aa3e-4098-a317-738b85576d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.687744 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196a1d-aa3e-4098-a317-738b85576d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.687744 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196a1d-aa3e-4098-a317-738b85576d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.687744 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196a1d-aa3e-4098-a317-738b85576d31 admin admin] PATH_INFO: `/v3/projects/ca5a7609b4544804b405e3345280026c/users/d051f967ac9a412c82791a17b0dc7248/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.688014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 762/1538] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:35:43 2021] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:43.688014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec97a1-63fe-4ec6-b1f2-052931914c25 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.688014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec97a1-63fe-4ec6-b1f2-052931914c25 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.688014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec97a1-63fe-4ec6-b1f2-052931914c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.696732 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0196a1d-aa3e-4098-a317-738b85576d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca5a7609b4544804b405e3345280026c, user_id=d051f967ac9a412c82791a17b0dc7248, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.699627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0196a1d-aa3e-4098-a317-738b85576d31 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.706736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-2cec97a1-63fe-4ec6-b1f2-052931914c25 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:43.708005 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-2cec97a1-63fe-4ec6-b1f2-052931914c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:43.715880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 763/1539] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:43.717126 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af57a9-7b6e-4770-9205-29cdaa0d8650 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.717413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af57a9-7b6e-4770-9205-29cdaa0d8650 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.717687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af57a9-7b6e-4770-9205-29cdaa0d8650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.738192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-09af57a9-7b6e-4770-9205-29cdaa0d8650 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:43.741080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-09af57a9-7b6e-4770-9205-29cdaa0d8650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:43.748462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 764/1540] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:43.749328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af57a9-7b6e-4770-9205-29cdaa0d8650 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.758929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af57a9-7b6e-4770-9205-29cdaa0d8650 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.764925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8c7d5-c66f-43f4-8840-fa01bdba42bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.765581 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8c7d5-c66f-43f4-8840-fa01bdba42bc admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.765972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8c7d5-c66f-43f4-8840-fa01bdba42bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.766251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8c7d5-c66f-43f4-8840-fa01bdba42bc admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.766982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8c7d5-c66f-43f4-8840-fa01bdba42bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.768573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8c7d5-c66f-43f4-8840-fa01bdba42bc admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.779298 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 765/1541] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:43.780111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8c7d5-c66f-43f4-8840-fa01bdba42bc admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.789379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8c7d5-c66f-43f4-8840-fa01bdba42bc admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.794178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053fd87-77f1-4b0a-b93d-7313640a12fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.794820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053fd87-77f1-4b0a-b93d-7313640a12fe admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.795099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053fd87-77f1-4b0a-b93d-7313640a12fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.795372 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053fd87-77f1-4b0a-b93d-7313640a12fe admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.796111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053fd87-77f1-4b0a-b93d-7313640a12fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.797661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053fd87-77f1-4b0a-b93d-7313640a12fe admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.805754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 777/1542] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:35:43 2021] PUT /identity/v3/projects/ca5a7609b4544804b405e3345280026c/users/d051f967ac9a412c82791a17b0dc7248/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:35:43.807349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0196a1d-aa3e-4098-a317-738b85576d31 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.810193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 766/1543] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:43.810193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053fd87-77f1-4b0a-b93d-7313640a12fe admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.819603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053fd87-77f1-4b0a-b93d-7313640a12fe admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.871075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0196a1d-aa3e-4098-a317-738b85576d31 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.875690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0f1e-19fb-42ed-866e-705ea15cdba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.875869 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6edfec-df2f-4191-83a8-ab4d4c5fb627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.876352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0f1e-19fb-42ed-866e-705ea15cdba6 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.876530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6edfec-df2f-4191-83a8-ab4d4c5fb627 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.876627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0f1e-19fb-42ed-866e-705ea15cdba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.876809 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6edfec-df2f-4191-83a8-ab4d4c5fb627 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.876903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0f1e-19fb-42ed-866e-705ea15cdba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.877084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6edfec-df2f-4191-83a8-ab4d4c5fb627 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.877635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e0f1e-19fb-42ed-866e-705ea15cdba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.877791 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6edfec-df2f-4191-83a8-ab4d4c5fb627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.879253 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e0f1e-19fb-42ed-866e-705ea15cdba6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.879386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6edfec-df2f-4191-83a8-ab4d4c5fb627 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.889677 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 778/1545] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:43.889857 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 767/1545] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:43.890342 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0f1e-19fb-42ed-866e-705ea15cdba6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.891898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6edfec-df2f-4191-83a8-ab4d4c5fb627 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.949788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0f1e-19fb-42ed-866e-705ea15cdba6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.953984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6edfec-df2f-4191-83a8-ab4d4c5fb627 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.954425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669acfa-28bb-4a78-a009-bb482b2c5d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.955096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669acfa-28bb-4a78-a009-bb482b2c5d86 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.955366 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669acfa-28bb-4a78-a009-bb482b2c5d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.955644 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669acfa-28bb-4a78-a009-bb482b2c5d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.959212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8055ad-5788-4fa7-a4f0-503411539d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.960105 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8055ad-5788-4fa7-a4f0-503411539d40 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.960384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8055ad-5788-4fa7-a4f0-503411539d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.960729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8055ad-5788-4fa7-a4f0-503411539d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.967097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669acfa-28bb-4a78-a009-bb482b2c5d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.968527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669acfa-28bb-4a78-a009-bb482b2c5d86 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.970713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8055ad-5788-4fa7-a4f0-503411539d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:43.972547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8055ad-5788-4fa7-a4f0-503411539d40 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:43.979120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 768/1546] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:43.979965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669acfa-28bb-4a78-a009-bb482b2c5d86 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:43.985828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 779/1547] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:43.989035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a1efc-42b0-4e8a-80a1-da3bfff8ebed None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.989035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a1efc-42b0-4e8a-80a1-da3bfff8ebed None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.989035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a1efc-42b0-4e8a-80a1-da3bfff8ebed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:43.989310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669acfa-28bb-4a78-a009-bb482b2c5d86 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:43.994811 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315a04-8edf-46e7-89e0-5081333b8b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:43.995702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315a04-8edf-46e7-89e0-5081333b8b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:43.995983 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315a04-8edf-46e7-89e0-5081333b8b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:43.996257 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315a04-8edf-46e7-89e0-5081333b8b61 admin admin] PATH_INFO: `/v3/projects/55a1ad2f22c04639ad4b47574527b7a9/users/afc9bdb75006427795bfc47937f9d6c0/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.023066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-586a1efc-42b0-4e8a-80a1-da3bfff8ebed None None] MFA Rules not processed for user `d051f967ac9a412c82791a17b0dc7248`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:44.024776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-586a1efc-42b0-4e8a-80a1-da3bfff8ebed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:44.030757 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315a04-8edf-46e7-89e0-5081333b8b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a1ad2f22c04639ad4b47574527b7a9, user_id=afc9bdb75006427795bfc47937f9d6c0, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:44.033415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315a04-8edf-46e7-89e0-5081333b8b61 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:44.089950 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 780/1548] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:43 2021] POST /identity/v3/auth/tokens => generated 3377 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:44.090772 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a1efc-42b0-4e8a-80a1-da3bfff8ebed None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:44.100413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a1efc-42b0-4e8a-80a1-da3bfff8ebed None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:44.105833 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d87b4-9f84-4cea-945f-b9ad872554e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:44.106713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d87b4-9f84-4cea-945f-b9ad872554e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.106999 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d87b4-9f84-4cea-945f-b9ad872554e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.107276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d87b4-9f84-4cea-945f-b9ad872554e7 admin admin] PATH_INFO: `/v3/projects/27f2b6ca8e714503a38d20c10983ad79/users/bd2b3e43107d4678998b0e898c1fa7c9/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.122597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d87b4-9f84-4cea-945f-b9ad872554e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f2b6ca8e714503a38d20c10983ad79, user_id=bd2b3e43107d4678998b0e898c1fa7c9, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:44.132449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d87b4-9f84-4cea-945f-b9ad872554e7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:44.132726 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 769/1549] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:35:43 2021] PUT /identity/v3/projects/55a1ad2f22c04639ad4b47574527b7a9/users/afc9bdb75006427795bfc47937f9d6c0/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:35:44.132726 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315a04-8edf-46e7-89e0-5081333b8b61 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:44.193848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315a04-8edf-46e7-89e0-5081333b8b61 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:44.198804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982e390-40e3-419e-a899-47288ab66abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:44.199710 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982e390-40e3-419e-a899-47288ab66abe admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.200001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982e390-40e3-419e-a899-47288ab66abe admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.200276 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982e390-40e3-419e-a899-47288ab66abe admin admin] PATH_INFO: `/v3/projects/d29fa9f70a9b4bb3a2a98c211f212239/users/d413ca9ab62245eeada2a04c4c06108a/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.214332 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982e390-40e3-419e-a899-47288ab66abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29fa9f70a9b4bb3a2a98c211f212239, user_id=d413ca9ab62245eeada2a04c4c06108a, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:44.216953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982e390-40e3-419e-a899-47288ab66abe admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:44.247343 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 781/1550] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:35:44 2021] PUT /identity/v3/projects/27f2b6ca8e714503a38d20c10983ad79/users/bd2b3e43107d4678998b0e898c1fa7c9/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:35:44.247343 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d87b4-9f84-4cea-945f-b9ad872554e7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:44.300731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d87b4-9f84-4cea-945f-b9ad872554e7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:44.307715 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458e225-9395-42a0-8113-4b56f306047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:44.308393 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458e225-9395-42a0-8113-4b56f306047b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.308691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458e225-9395-42a0-8113-4b56f306047b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.308969 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458e225-9395-42a0-8113-4b56f306047b admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.310196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458e225-9395-42a0-8113-4b56f306047b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:44.316557 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458e225-9395-42a0-8113-4b56f306047b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:44.321449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 782/1551] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:44 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:44.322886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458e225-9395-42a0-8113-4b56f306047b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:44.332440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458e225-9395-42a0-8113-4b56f306047b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:44.337072 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b0fd4-eebf-4763-b745-c39f7170ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:44.337767 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b0fd4-eebf-4763-b745-c39f7170ebbe admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.338678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b0fd4-eebf-4763-b745-c39f7170ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.343137 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b0fd4-eebf-4763-b745-c39f7170ebbe admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.343137 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b0fd4-eebf-4763-b745-c39f7170ebbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:44.343137 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b0fd4-eebf-4763-b745-c39f7170ebbe admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:44.345306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 770/1552] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:35:44 2021] PUT /identity/v3/projects/d29fa9f70a9b4bb3a2a98c211f212239/users/d413ca9ab62245eeada2a04c4c06108a/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:35:44.356005 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6b022-cfb7-4efd-bf31-db275acaac45 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.356304 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6b022-cfb7-4efd-bf31-db275acaac45 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.356741 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6b022-cfb7-4efd-bf31-db275acaac45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.374188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-00b6b022-cfb7-4efd-bf31-db275acaac45 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:44.375409 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-00b6b022-cfb7-4efd-bf31-db275acaac45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:44.440250 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 771/1553] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:44.441726 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12624-8df4-444f-86fd-9bb157b9f13d None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.442061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12624-8df4-444f-86fd-9bb157b9f13d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.442340 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12624-8df4-444f-86fd-9bb157b9f13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.449049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 783/1554] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:35:44 2021] POST /identity/v3/projects => generated 357 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:44.449991 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b0fd4-eebf-4763-b745-c39f7170ebbe admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:44.461326 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f5f12624-8df4-444f-86fd-9bb157b9f13d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:44.462547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f5f12624-8df4-444f-86fd-9bb157b9f13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:44.527789 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 772/1555] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:44.529206 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f3a17-91dd-47f8-a304-c6d047ebc6cc None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.529549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f3a17-91dd-47f8-a304-c6d047ebc6cc None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.529934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f3a17-91dd-47f8-a304-c6d047ebc6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.547949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b0fd4-eebf-4763-b745-c39f7170ebbe admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:44.553678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2601c9-6add-434c-a9d9-9fd78ec24146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:44.554571 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2601c9-6add-434c-a9d9-9fd78ec24146 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.554847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2601c9-6add-434c-a9d9-9fd78ec24146 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.555116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2601c9-6add-434c-a9d9-9fd78ec24146 admin admin] PATH_INFO: `/v3/projects/5afdc403b79a4f7593edca91c2b7f882/users/304ebf23ad9c47eeba8baec42e096a2b/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.557359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-581f3a17-91dd-47f8-a304-c6d047ebc6cc None None] MFA Rules not processed for user `d413ca9ab62245eeada2a04c4c06108a`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:44.559137 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-581f3a17-91dd-47f8-a304-c6d047ebc6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:44.570504 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2601c9-6add-434c-a9d9-9fd78ec24146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afdc403b79a4f7593edca91c2b7f882, user_id=304ebf23ad9c47eeba8baec42e096a2b, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:44.573518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2601c9-6add-434c-a9d9-9fd78ec24146 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:44.626530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 773/1556] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:44 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:44.627777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f3a17-91dd-47f8-a304-c6d047ebc6cc None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:44.652877 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 784/1557] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:35:44 2021] PUT /identity/v3/projects/5afdc403b79a4f7593edca91c2b7f882/users/304ebf23ad9c47eeba8baec42e096a2b/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:35:44.653993 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2601c9-6add-434c-a9d9-9fd78ec24146 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:44.681242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f3a17-91dd-47f8-a304-c6d047ebc6cc None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:44.724608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2601c9-6add-434c-a9d9-9fd78ec24146 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:44.730621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be7cc6-38ae-45f8-9603-ace471c9ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:44.731067 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffbd8d-aa51-42ca-80e4-bfe9886064f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:44.731658 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7cc6-38ae-45f8-9603-ace471c9ebb9 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.731779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffbd8d-aa51-42ca-80e4-bfe9886064f7 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.732092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffbd8d-aa51-42ca-80e4-bfe9886064f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.732233 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7cc6-38ae-45f8-9603-ace471c9ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.732337 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffbd8d-aa51-42ca-80e4-bfe9886064f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.732594 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7cc6-38ae-45f8-9603-ace471c9ebb9 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.733667 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be7cc6-38ae-45f8-9603-ace471c9ebb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:44.736295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be7cc6-38ae-45f8-9603-ace471c9ebb9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:44.742427 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffbd8d-aa51-42ca-80e4-bfe9886064f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:44.743439 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffbd8d-aa51-42ca-80e4-bfe9886064f7 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:44.754889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 774/1558] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:44.755731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffbd8d-aa51-42ca-80e4-bfe9886064f7 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:44.764595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffbd8d-aa51-42ca-80e4-bfe9886064f7 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:44.770474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137dc2e-b659-4180-bc1d-432ff8fb37d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:44.770474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137dc2e-b659-4180-bc1d-432ff8fb37d9 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.770474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137dc2e-b659-4180-bc1d-432ff8fb37d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.770474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137dc2e-b659-4180-bc1d-432ff8fb37d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.781113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137dc2e-b659-4180-bc1d-432ff8fb37d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:44.782398 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137dc2e-b659-4180-bc1d-432ff8fb37d9 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:44.794118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 775/1559] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:44.799017 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba8e7f-d8ed-46f5-bd50-30d5fe4204d5 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.799017 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba8e7f-d8ed-46f5-bd50-30d5fe4204d5 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.799017 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba8e7f-d8ed-46f5-bd50-30d5fe4204d5 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.799017 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 776/1560] 10.222.0.16 () {54 vars in 961 bytes} [Sun Aug 29 14:35:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:35:44.799017 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eafb53-63f3-4884-8282-77a01acb77cc None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.799471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eafb53-63f3-4884-8282-77a01acb77cc None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.799471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eafb53-63f3-4884-8282-77a01acb77cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.818921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-98eafb53-63f3-4884-8282-77a01acb77cc None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:44.818921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-98eafb53-63f3-4884-8282-77a01acb77cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:44.827933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 777/1561] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:44.829416 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb34f7d-e494-4b9f-891e-8970db0d3ffb None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.829761 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb34f7d-e494-4b9f-891e-8970db0d3ffb None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.830121 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb34f7d-e494-4b9f-891e-8970db0d3ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.849787 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-7eb34f7d-e494-4b9f-891e-8970db0d3ffb None None] MFA Rules not processed for user `d8c0afa8f09f4923b9c8ab2696156129`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:44.851136 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7eb34f7d-e494-4b9f-891e-8970db0d3ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:44.856355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 785/1562] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:35:44 2021] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:44.856355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be7cc6-38ae-45f8-9603-ace471c9ebb9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:44.866879 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be7cc6-38ae-45f8-9603-ace471c9ebb9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:44.871371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40e727-61a5-4b5d-a9c1-bade9c5b02d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:44.872022 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40e727-61a5-4b5d-a9c1-bade9c5b02d4 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.872314 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40e727-61a5-4b5d-a9c1-bade9c5b02d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.872595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40e727-61a5-4b5d-a9c1-bade9c5b02d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.882410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40e727-61a5-4b5d-a9c1-bade9c5b02d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:44.883862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40e727-61a5-4b5d-a9c1-bade9c5b02d4 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:44.894702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 786/1563] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:44.895825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40e727-61a5-4b5d-a9c1-bade9c5b02d4 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:44.905561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40e727-61a5-4b5d-a9c1-bade9c5b02d4 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:44.910693 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d6453-ae3f-4ce2-a88d-e6c852b33c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:44.911468 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d6453-ae3f-4ce2-a88d-e6c852b33c2f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.911758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d6453-ae3f-4ce2-a88d-e6c852b33c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.912038 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d6453-ae3f-4ce2-a88d-e6c852b33c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.912782 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d6453-ae3f-4ce2-a88d-e6c852b33c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:44.914399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d6453-ae3f-4ce2-a88d-e6c852b33c2f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:44.925290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 778/1564] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Aug 29 14:35:44 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:44.926622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 787/1565] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:44.931378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb34f7d-e494-4b9f-891e-8970db0d3ffb None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:44.938541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d6453-ae3f-4ce2-a88d-e6c852b33c2f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:44.942880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb34f7d-e494-4b9f-891e-8970db0d3ffb None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:44.947453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6e116-16ee-4ae2-b889-46581e3c5d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:44.948796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6e116-16ee-4ae2-b889-46581e3c5d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.949078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6e116-16ee-4ae2-b889-46581e3c5d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.953581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d6453-ae3f-4ce2-a88d-e6c852b33c2f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:44.958284 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6e116-16ee-4ae2-b889-46581e3c5d1e admin admin] PATH_INFO: `/v3/projects/99c17fd84c344115a2acbc1be4c0a165/users/4fb51a97c70d4d2384c3e229fc99af45/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.959731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9756476-3d83-443d-97e0-5ec55879a639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:44.960546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9756476-3d83-443d-97e0-5ec55879a639 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:44.960768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9756476-3d83-443d-97e0-5ec55879a639 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:44.960977 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9756476-3d83-443d-97e0-5ec55879a639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:44.985736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6e116-16ee-4ae2-b889-46581e3c5d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c17fd84c344115a2acbc1be4c0a165, user_id=4fb51a97c70d4d2384c3e229fc99af45, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:44.989356 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6e116-16ee-4ae2-b889-46581e3c5d1e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:45.031971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9756476-3d83-443d-97e0-5ec55879a639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:45.034186 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9756476-3d83-443d-97e0-5ec55879a639 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:45.046106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 788/1566] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:44 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:45.092033 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 779/1567] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:35:44 2021] PUT /identity/v3/projects/99c17fd84c344115a2acbc1be4c0a165/users/4fb51a97c70d4d2384c3e229fc99af45/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:35:45.095811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9756476-3d83-443d-97e0-5ec55879a639 service nova] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:45.107858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9756476-3d83-443d-97e0-5ec55879a639 service nova] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:45.178393 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a044a3-49a1-486d-9808-62d155c3d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:45.179127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a044a3-49a1-486d-9808-62d155c3d811 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.179414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a044a3-49a1-486d-9808-62d155c3d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.179705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a044a3-49a1-486d-9808-62d155c3d811 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.180411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a044a3-49a1-486d-9808-62d155c3d811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:45.182773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a044a3-49a1-486d-9808-62d155c3d811 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:45.197468 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 789/1568] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:45 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:45.198265 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6e116-16ee-4ae2-b889-46581e3c5d1e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:45.209789 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6e116-16ee-4ae2-b889-46581e3c5d1e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:45.221375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f67606-9ced-4c08-9f88-e06380e169cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:45.223349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f67606-9ced-4c08-9f88-e06380e169cb admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.223838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f67606-9ced-4c08-9f88-e06380e169cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.224421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f67606-9ced-4c08-9f88-e06380e169cb admin admin] PATH_INFO: `/v3/projects/99c17fd84c344115a2acbc1be4c0a165/users/4fb51a97c70d4d2384c3e229fc99af45/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.226833 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f67606-9ced-4c08-9f88-e06380e169cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c17fd84c344115a2acbc1be4c0a165, user_id=4fb51a97c70d4d2384c3e229fc99af45, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:45.230896 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f67606-9ced-4c08-9f88-e06380e169cb admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:45.242830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 780/1569] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:35:45 2021] PUT /identity/v3/projects/99c17fd84c344115a2acbc1be4c0a165/users/4fb51a97c70d4d2384c3e229fc99af45/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:35:45.260046 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea274cc-4b79-43ec-ba30-d149d895bd50 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.261756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea274cc-4b79-43ec-ba30-d149d895bd50 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.261756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea274cc-4b79-43ec-ba30-d149d895bd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.296001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-1ea274cc-4b79-43ec-ba30-d149d895bd50 None None] MFA Rules not processed for user `4fb51a97c70d4d2384c3e229fc99af45`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:45.299889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1ea274cc-4b79-43ec-ba30-d149d895bd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:45.325510 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f39695-fa5b-44c7-b8e8-2c3fa9ade257 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.325795 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f39695-fa5b-44c7-b8e8-2c3fa9ade257 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.326134 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f39695-fa5b-44c7-b8e8-2c3fa9ade257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.358894 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-08f39695-fa5b-44c7-b8e8-2c3fa9ade257 None None] MFA Rules not processed for user `569387965b184cc3a1bc2aecdbede0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:45.360767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-08f39695-fa5b-44c7-b8e8-2c3fa9ade257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:45.395951 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 790/1570] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:45 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:45.397652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272e364-c915-44af-bf74-40bd2b039296 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.398014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272e364-c915-44af-bf74-40bd2b039296 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.398405 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272e364-c915-44af-bf74-40bd2b039296 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.402437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 791/1571] 10.222.0.16 () {54 vars in 912 bytes} [Sun Aug 29 14:35:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:35:45.407383 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272e364-c915-44af-bf74-40bd2b039296 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:45.444603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 781/1572] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:45 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:45.446235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08987ce-fbf3-4163-ba89-a31868b31c1c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.446631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08987ce-fbf3-4163-ba89-a31868b31c1c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.447031 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08987ce-fbf3-4163-ba89-a31868b31c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.466706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-b08987ce-fbf3-4163-ba89-a31868b31c1c None None] MFA Rules not processed for user `d8c0afa8f09f4923b9c8ab2696156129`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:45.468065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b08987ce-fbf3-4163-ba89-a31868b31c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:45.476251 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272e364-c915-44af-bf74-40bd2b039296 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:45.481352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd96c-01fb-479f-b413-951b676fb62d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:45.482403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd96c-01fb-479f-b413-951b676fb62d service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.482696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd96c-01fb-479f-b413-951b676fb62d service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.482976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd96c-01fb-479f-b413-951b676fb62d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.499608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd96c-01fb-479f-b413-951b676fb62d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:45.501327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd96c-01fb-479f-b413-951b676fb62d service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:45.512510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 792/1573] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:45 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:35:45.513758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035275a-1097-4033-9e40-4dfb35687573 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.514203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035275a-1097-4033-9e40-4dfb35687573 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.514608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035275a-1097-4033-9e40-4dfb35687573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.532874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0035275a-1097-4033-9e40-4dfb35687573 None None] MFA Rules not processed for user `569387965b184cc3a1bc2aecdbede0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:45.534122 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0035275a-1097-4033-9e40-4dfb35687573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:45.541902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 793/1574] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:45 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:45.547572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 782/1575] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:35:45 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:45.559140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a589eb-83a4-4f5e-94bc-cb24ea4b3e03 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.559612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a589eb-83a4-4f5e-94bc-cb24ea4b3e03 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.559964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a589eb-83a4-4f5e-94bc-cb24ea4b3e03 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.560065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08987ce-fbf3-4163-ba89-a31868b31c1c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:45.562023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 794/1576] 10.222.0.16 () {54 vars in 961 bytes} [Sun Aug 29 14:35:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:35:45.571042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772681-f35b-4af2-8002-a4e720d447b3 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.571042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772681-f35b-4af2-8002-a4e720d447b3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.571042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772681-f35b-4af2-8002-a4e720d447b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.571444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08987ce-fbf3-4163-ba89-a31868b31c1c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:45.573040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9781e7-a958-48ff-9a57-fdc5f8bc4d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:45.573729 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9781e7-a958-48ff-9a57-fdc5f8bc4d98 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.574068 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9781e7-a958-48ff-9a57-fdc5f8bc4d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.574341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9781e7-a958-48ff-9a57-fdc5f8bc4d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.584455 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9781e7-a958-48ff-9a57-fdc5f8bc4d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:45.585888 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9781e7-a958-48ff-9a57-fdc5f8bc4d98 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:45.586560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-63772681-f35b-4af2-8002-a4e720d447b3 None None] MFA Rules not processed for user `d8c0afa8f09f4923b9c8ab2696156129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:45.589088 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-63772681-f35b-4af2-8002-a4e720d447b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:45.601953 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 795/1577] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Aug 29 14:35:45 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:35:45.610216 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 783/1578] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:45 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:35:45.615800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9781e7-a958-48ff-9a57-fdc5f8bc4d98 service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:45.637715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9781e7-a958-48ff-9a57-fdc5f8bc4d98 service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:45.654370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9582932-282b-4ec4-b007-087865fd6653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:45.655022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9582932-282b-4ec4-b007-087865fd6653 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.655301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9582932-282b-4ec4-b007-087865fd6653 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.655572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9582932-282b-4ec4-b007-087865fd6653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.675192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9582932-282b-4ec4-b007-087865fd6653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:45.676762 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9582932-282b-4ec4-b007-087865fd6653 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:45.695901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 784/1579] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:45 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:45.782115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63772681-f35b-4af2-8002-a4e720d447b3 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:45.792313 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63772681-f35b-4af2-8002-a4e720d447b3 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:45.796012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42fa97-753e-4e60-918f-44caacdcb835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:45.796706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42fa97-753e-4e60-918f-44caacdcb835 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:45.796989 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42fa97-753e-4e60-918f-44caacdcb835 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:45.797259 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42fa97-753e-4e60-918f-44caacdcb835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:45.884126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42fa97-753e-4e60-918f-44caacdcb835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:45.888348 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42fa97-753e-4e60-918f-44caacdcb835 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:45.920727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 796/1580] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:45 2021] GET /identity/v3/auth/tokens => generated 3377 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:46.059974 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6159d8f-8f35-4264-aceb-ff20a05a719f None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:46.060344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6159d8f-8f35-4264-aceb-ff20a05a719f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:46.060715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6159d8f-8f35-4264-aceb-ff20a05a719f None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:46.062694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 785/1581] 10.222.0.16 () {54 vars in 912 bytes} [Sun Aug 29 14:35:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:35:46.068449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0a70-bb59-418c-88e5-ab703015ead6 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:46.068748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0a70-bb59-418c-88e5-ab703015ead6 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:46.069031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0a70-bb59-418c-88e5-ab703015ead6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:46.088354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-999f0a70-bb59-418c-88e5-ab703015ead6 None None] MFA Rules not processed for user `d8c0afa8f09f4923b9c8ab2696156129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:46.089749 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-999f0a70-bb59-418c-88e5-ab703015ead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:46.099702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 797/1582] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:35:46 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:46.114012 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6159d8f-8f35-4264-aceb-ff20a05a719f None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:46.116006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e6159d8f-8f35-4264-aceb-ff20a05a719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:46.187548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6159d8f-8f35-4264-aceb-ff20a05a719f None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:46.192836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ec68f-6b4a-4fdc-a2bf-562cddd3f7bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db83070471e34df695b571cdab440b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:46.193556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ec68f-6b4a-4fdc-a2bf-562cddd3f7bc service glance] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:46.193917 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ec68f-6b4a-4fdc-a2bf-562cddd3f7bc service glance] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:46.194245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ec68f-6b4a-4fdc-a2bf-562cddd3f7bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:46.208667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ec68f-6b4a-4fdc-a2bf-562cddd3f7bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:46.210950 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ec68f-6b4a-4fdc-a2bf-562cddd3f7bc service glance] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:46.235355 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 786/1583] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:46.663391 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3434eb-fc2c-45cf-a258-6b466f7cb513 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:46.663876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3434eb-fc2c-45cf-a258-6b466f7cb513 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:46.664062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3434eb-fc2c-45cf-a258-6b466f7cb513 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:46.666846 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 798/1584] 10.222.0.16 () {54 vars in 912 bytes} [Sun Aug 29 14:35:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:35:46.683485 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66bd0a-bfb4-4a85-b378-ce2f1a416b0b None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:46.683719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66bd0a-bfb4-4a85-b378-ce2f1a416b0b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:46.683997 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66bd0a-bfb4-4a85-b378-ce2f1a416b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:46.740625 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-cd66bd0a-bfb4-4a85-b378-ce2f1a416b0b None None] MFA Rules not processed for user `f13a39de23f04cb0a2f5b050d740334a`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:46.741848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-cd66bd0a-bfb4-4a85-b378-ce2f1a416b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:46.848288 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 787/1585] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:35:46 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:35:46.864317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3434eb-fc2c-45cf-a258-6b466f7cb513 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:46.883243 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3434eb-fc2c-45cf-a258-6b466f7cb513 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:46.892650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c6be8-6c16-43ac-ac17-6eb68e408106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:46.895580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c6be8-6c16-43ac-ac17-6eb68e408106 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:46.896090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c6be8-6c16-43ac-ac17-6eb68e408106 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:46.896575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c6be8-6c16-43ac-ac17-6eb68e408106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:46.918517 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c6be8-6c16-43ac-ac17-6eb68e408106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:46.920408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c6be8-6c16-43ac-ac17-6eb68e408106 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:46.939747 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 799/1586] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:46 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:35:47.663879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66bd0a-bfb4-4a85-b378-ce2f1a416b0b None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:47.753933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66bd0a-bfb4-4a85-b378-ce2f1a416b0b None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:47.760165 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0023010-c02e-4f21-8ac1-fb28e2d94e4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77a408df11844e2aacbb366019dc3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:47.761127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0023010-c02e-4f21-8ac1-fb28e2d94e4a service placement] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:47.762253 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0023010-c02e-4f21-8ac1-fb28e2d94e4a service placement] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:47.762783 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0023010-c02e-4f21-8ac1-fb28e2d94e4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:47.768104 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c0023010-c02e-4f21-8ac1-fb28e2d94e4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:47.787785 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0023010-c02e-4f21-8ac1-fb28e2d94e4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:47.789637 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0023010-c02e-4f21-8ac1-fb28e2d94e4a service placement] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:47.812974 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 788/1587] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:47 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:47.814884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18980b4-4be5-4880-b79d-568fb39c5236 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:47.815337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18980b4-4be5-4880-b79d-568fb39c5236 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:47.815452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18980b4-4be5-4880-b79d-568fb39c5236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:47.903811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c18980b4-4be5-4880-b79d-568fb39c5236 None None] MFA Rules not processed for user `afc9bdb75006427795bfc47937f9d6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:47.905061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c18980b4-4be5-4880-b79d-568fb39c5236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:48.044798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe2d1c-f86b-47a7-9e6e-7279fe6e337c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:48.045108 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe2d1c-f86b-47a7-9e6e-7279fe6e337c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:48.046207 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe2d1c-f86b-47a7-9e6e-7279fe6e337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:48.064326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 800/1588] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:47 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:48.068510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18980b4-4be5-4880-b79d-568fb39c5236 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:48.134146 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-befe2d1c-f86b-47a7-9e6e-7279fe6e337c None None] MFA Rules not processed for user `bd2b3e43107d4678998b0e898c1fa7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:48.137399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-befe2d1c-f86b-47a7-9e6e-7279fe6e337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:48.258318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18980b4-4be5-4880-b79d-568fb39c5236 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:48.270057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa82c1e-2b1a-4d6c-8603-a682f9bc4340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:48.272474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa82c1e-2b1a-4d6c-8603-a682f9bc4340 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:48.272474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa82c1e-2b1a-4d6c-8603-a682f9bc4340 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:48.272474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa82c1e-2b1a-4d6c-8603-a682f9bc4340 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:48.272850 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa82c1e-2b1a-4d6c-8603-a682f9bc4340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:48.278134 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa82c1e-2b1a-4d6c-8603-a682f9bc4340 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:48.336151 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 789/1589] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:48 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:35:48.348604 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde21d57-3bed-40af-be87-3714809cb2ec None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:48.355086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde21d57-3bed-40af-be87-3714809cb2ec None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:48.355086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde21d57-3bed-40af-be87-3714809cb2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:48.400788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-bde21d57-3bed-40af-be87-3714809cb2ec None None] MFA Rules not processed for user `bd2b3e43107d4678998b0e898c1fa7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:48.407852 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-bde21d57-3bed-40af-be87-3714809cb2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:48.429927 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 790/1590] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:48 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:35:48.444369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde21d57-3bed-40af-be87-3714809cb2ec None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:48.471315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde21d57-3bed-40af-be87-3714809cb2ec None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:48.485430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 801/1591] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:35:48 2021] POST /identity/v3/projects => generated 403 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:48.489617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa82c1e-2b1a-4d6c-8603-a682f9bc4340 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:48.499382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706905bc-a249-47d1-8eb2-275279e43ba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:48.500682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706905bc-a249-47d1-8eb2-275279e43ba3 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:48.501275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706905bc-a249-47d1-8eb2-275279e43ba3 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:48.501838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706905bc-a249-47d1-8eb2-275279e43ba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:48.522360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706905bc-a249-47d1-8eb2-275279e43ba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:48.523843 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706905bc-a249-47d1-8eb2-275279e43ba3 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:48.555077 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 791/1592] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:48 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:35:48.585017 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa82c1e-2b1a-4d6c-8603-a682f9bc4340 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:48.592281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0640c-1838-4a89-823a-68d9fdfc4e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:48.593428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0640c-1838-4a89-823a-68d9fdfc4e67 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:48.593713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0640c-1838-4a89-823a-68d9fdfc4e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:48.594020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0640c-1838-4a89-823a-68d9fdfc4e67 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:48.594792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0640c-1838-4a89-823a-68d9fdfc4e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:48.596687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0640c-1838-4a89-823a-68d9fdfc4e67 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:48.699840 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 802/1593] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:35:48 2021] POST /identity/v3/users => generated 308 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:35:48.704207 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706905bc-a249-47d1-8eb2-275279e43ba3 service nova] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:48.717052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706905bc-a249-47d1-8eb2-275279e43ba3 service nova] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:48.722599 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f052d9-c32c-4ed5-8cf5-c5d01521cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:48.723523 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f052d9-c32c-4ed5-8cf5-c5d01521cba3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:48.725581 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f052d9-c32c-4ed5-8cf5-c5d01521cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:48.726076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f052d9-c32c-4ed5-8cf5-c5d01521cba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:48.727046 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f052d9-c32c-4ed5-8cf5-c5d01521cba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:48.729230 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f052d9-c32c-4ed5-8cf5-c5d01521cba3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:48.741263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 792/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:35:48.745180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0640c-1838-4a89-823a-68d9fdfc4e67 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:48.757479 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0640c-1838-4a89-823a-68d9fdfc4e67 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:48.771636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7fa1e-4b77-49ed-aebf-70e145afd2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:48.773104 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7fa1e-4b77-49ed-aebf-70e145afd2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:48.773104 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7fa1e-4b77-49ed-aebf-70e145afd2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:48.773587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7fa1e-4b77-49ed-aebf-70e145afd2f4 admin admin] PATH_INFO: `/v3/projects/c0faa41a0a6f47918344c4d923599733/users/a13f9cc82a6e4278be92f467fc620e77/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:48.805638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7fa1e-4b77-49ed-aebf-70e145afd2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0faa41a0a6f47918344c4d923599733, user_id=a13f9cc82a6e4278be92f467fc620e77, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:48.815576 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7fa1e-4b77-49ed-aebf-70e145afd2f4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:48.928589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 803/1595] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:35:48 2021] PUT /identity/v3/projects/c0faa41a0a6f47918344c4d923599733/users/a13f9cc82a6e4278be92f467fc620e77/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:35:48.932545 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f052d9-c32c-4ed5-8cf5-c5d01521cba3 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:48.947752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f052d9-c32c-4ed5-8cf5-c5d01521cba3 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:49.061094 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79269f4-f8c6-4f1c-a3ab-8f42d5fa73f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:49.062052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79269f4-f8c6-4f1c-a3ab-8f42d5fa73f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:49.062508 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79269f4-f8c6-4f1c-a3ab-8f42d5fa73f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:49.063210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79269f4-f8c6-4f1c-a3ab-8f42d5fa73f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:49.064094 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79269f4-f8c6-4f1c-a3ab-8f42d5fa73f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:49.066391 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79269f4-f8c6-4f1c-a3ab-8f42d5fa73f3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:49.087461 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 793/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:35:48 2021] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:35:49.091252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7fa1e-4b77-49ed-aebf-70e145afd2f4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:49.112630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7fa1e-4b77-49ed-aebf-70e145afd2f4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:49.121189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d27932-6955-4fe0-b84d-8b6dad5bc41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:49.122502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d27932-6955-4fe0-b84d-8b6dad5bc41b admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:49.122956 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d27932-6955-4fe0-b84d-8b6dad5bc41b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:49.123392 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d27932-6955-4fe0-b84d-8b6dad5bc41b admin admin] PATH_INFO: `/v3/projects/c0faa41a0a6f47918344c4d923599733/users/a13f9cc82a6e4278be92f467fc620e77/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:49.127120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d27932-6955-4fe0-b84d-8b6dad5bc41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0faa41a0a6f47918344c4d923599733, user_id=a13f9cc82a6e4278be92f467fc620e77, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:49.130713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d27932-6955-4fe0-b84d-8b6dad5bc41b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:49.170052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 804/1597] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:35:49 2021] PUT /identity/v3/projects/c0faa41a0a6f47918344c4d923599733/users/a13f9cc82a6e4278be92f467fc620e77/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:35:53.515569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852170f8-5522-4e4f-9ba0-79f733bdb280 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:53.517938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852170f8-5522-4e4f-9ba0-79f733bdb280 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:53.518421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852170f8-5522-4e4f-9ba0-79f733bdb280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:53.592223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-852170f8-5522-4e4f-9ba0-79f733bdb280 None None] MFA Rules not processed for user `a13f9cc82a6e4278be92f467fc620e77`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:53.594254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-852170f8-5522-4e4f-9ba0-79f733bdb280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:53.750006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 794/1598] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:53 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:55.600846 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62222da-8822-41d8-aee6-685de1425d76 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:55.601482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62222da-8822-41d8-aee6-685de1425d76 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:55.605188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62222da-8822-41d8-aee6-685de1425d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:55.657229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c62222da-8822-41d8-aee6-685de1425d76 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:55.678302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c62222da-8822-41d8-aee6-685de1425d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:55.770803 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 805/1599] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:35:55 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:55.906457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852170f8-5522-4e4f-9ba0-79f733bdb280 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:56.045134 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852170f8-5522-4e4f-9ba0-79f733bdb280 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:56.061999 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487c99c-5eec-4a5b-b1e9-c8e956e21be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:56.063060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487c99c-5eec-4a5b-b1e9-c8e956e21be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:56.063343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487c99c-5eec-4a5b-b1e9-c8e956e21be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:56.063619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487c99c-5eec-4a5b-b1e9-c8e956e21be9 admin admin] PATH_INFO: `/v3/users/d413ca9ab62245eeada2a04c4c06108a` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:56.068711 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487c99c-5eec-4a5b-b1e9-c8e956e21be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d413ca9ab62245eeada2a04c4c06108a)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:56.069931 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: WARNING py.warnings [None req-1487c99c-5eec-4a5b-b1e9-c8e956e21be9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:35:56.069931 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: warnings.warn(msg) Aug 29 14:35:56.069931 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: Aug 29 14:35:56.071157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487c99c-5eec-4a5b-b1e9-c8e956e21be9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:56.303470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62222da-8822-41d8-aee6-685de1425d76 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:56.305287 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c62222da-8822-41d8-aee6-685de1425d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:56.403028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1487c99c-5eec-4a5b-b1e9-c8e956e21be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd413ca9ab62245eeada2a04c4c06108a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:35:56.404162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1487c99c-5eec-4a5b-b1e9-c8e956e21be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd413ca9ab62245eeada2a04c4c06108a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:35:56.454072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1487c99c-5eec-4a5b-b1e9-c8e956e21be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd413ca9ab62245eeada2a04c4c06108a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:35:56.527420 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1487c99c-5eec-4a5b-b1e9-c8e956e21be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd413ca9ab62245eeada2a04c4c06108a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:35:56.551555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62222da-8822-41d8-aee6-685de1425d76 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:56.559923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48460f-3590-4b41-8cac-19c147ba4976 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:56.562805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48460f-3590-4b41-8cac-19c147ba4976 service swift] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:56.563092 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48460f-3590-4b41-8cac-19c147ba4976 service swift] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:56.563371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48460f-3590-4b41-8cac-19c147ba4976 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:56.580317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48460f-3590-4b41-8cac-19c147ba4976 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:56.580317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48460f-3590-4b41-8cac-19c147ba4976 service swift] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:56.588917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 806/1600] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:35:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 14:35:56.591343 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa9e73-9352-4b15-b1c7-526e05fea6e1 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:56.591689 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa9e73-9352-4b15-b1c7-526e05fea6e1 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:56.591884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa9e73-9352-4b15-b1c7-526e05fea6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:56.607019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1487c99c-5eec-4a5b-b1e9-c8e956e21be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd413ca9ab62245eeada2a04c4c06108a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:35:56.705846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 795/1601] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:35:55 2021] DELETE /identity/v3/users/d413ca9ab62245eeada2a04c4c06108a => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:35:56.705846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e07e7-dee2-4307-a4fd-d424cb54016f None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:56.705846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e07e7-dee2-4307-a4fd-d424cb54016f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:56.705846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e07e7-dee2-4307-a4fd-d424cb54016f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:56.715341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-09aa9e73-9352-4b15-b1c7-526e05fea6e1 None None] MFA Rules not processed for user `f44dac86674e41b78375a51798ea0cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:56.715341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-09aa9e73-9352-4b15-b1c7-526e05fea6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:56.777816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-af6e07e7-dee2-4307-a4fd-d424cb54016f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:56.779539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-af6e07e7-dee2-4307-a4fd-d424cb54016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:56.876802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 807/1602] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:56 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:56.886939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906e52a-4495-4d0f-9fe4-86ed1b65c4da None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:56.887224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906e52a-4495-4d0f-9fe4-86ed1b65c4da None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:56.887645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906e52a-4495-4d0f-9fe4-86ed1b65c4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:56.908888 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-9906e52a-4495-4d0f-9fe4-86ed1b65c4da None None] MFA Rules not processed for user `f44dac86674e41b78375a51798ea0cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:56.911417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-9906e52a-4495-4d0f-9fe4-86ed1b65c4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:56.919745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 808/1603] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:56 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:35:56.936045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906e52a-4495-4d0f-9fe4-86ed1b65c4da None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:56.938004 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-9906e52a-4495-4d0f-9fe4-86ed1b65c4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:57.054012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906e52a-4495-4d0f-9fe4-86ed1b65c4da None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:57.061278 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1da4ee-efff-479c-bd1b-b8b9f66488f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:57.061937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 796/1604] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:35:57.062448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1da4ee-efff-479c-bd1b-b8b9f66488f4 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:57.062448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1da4ee-efff-479c-bd1b-b8b9f66488f4 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:57.062725 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1da4ee-efff-479c-bd1b-b8b9f66488f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:57.065500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e07e7-dee2-4307-a4fd-d424cb54016f None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:57.072686 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1da4ee-efff-479c-bd1b-b8b9f66488f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:57.074657 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1da4ee-efff-479c-bd1b-b8b9f66488f4 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:57.074951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-af6e07e7-dee2-4307-a4fd-d424cb54016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:57.090025 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 809/1605] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:56 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:57.218106 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e07e7-dee2-4307-a4fd-d424cb54016f None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:57.218106 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f362c-5f97-42a6-a896-24def3ef6371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:57.218106 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f362c-5f97-42a6-a896-24def3ef6371 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:57.218106 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f362c-5f97-42a6-a896-24def3ef6371 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:57.221375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f362c-5f97-42a6-a896-24def3ef6371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:57.221375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f362c-5f97-42a6-a896-24def3ef6371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:57.221375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f362c-5f97-42a6-a896-24def3ef6371 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:57.221375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 797/1606] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:35:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:35:59.429829 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1da4ee-efff-479c-bd1b-b8b9f66488f4 service nova] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:35:59.433454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-9d1da4ee-efff-479c-bd1b-b8b9f66488f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:35:59.469819 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1da4ee-efff-479c-bd1b-b8b9f66488f4 service nova] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:35:59.475076 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:35:59.476620 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:59.478713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:59.479829 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] PATH_INFO: `/v3/projects/d29fa9f70a9b4bb3a2a98c211f212239` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:59.485346 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29fa9f70a9b4bb3a2a98c211f212239)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:35:59.487691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: WARNING py.warnings [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 14:35:59.487691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: warnings.warn(msg) Aug 29 14:35:59.487691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: Aug 29 14:35:59.489458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:35:59.693384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29fa9f70a9b4bb3a2a98c211f212239', 'request_id': 'req-834d9b26-e531-4d65-bcba-e0ade688a8fe'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:35:59.825824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29fa9f70a9b4bb3a2a98c211f212239', 'request_id': 'req-834d9b26-e531-4d65-bcba-e0ade688a8fe'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:35:59.839224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29fa9f70a9b4bb3a2a98c211f212239', 'request_id': 'req-834d9b26-e531-4d65-bcba-e0ade688a8fe'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:35:59.904252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] The token cache is being invalidate because project d29fa9f70a9b4bb3a2a98c211f212239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:35:59.904645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:35:59.905528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-834d9b26-e531-4d65-bcba-e0ade688a8fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:35:59.965942 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 810/1607] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:35:59 2021] DELETE /identity/v3/projects/d29fa9f70a9b4bb3a2a98c211f212239 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:35:59.967072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07cb06-ff61-498b-83f5-24a4100e6f18 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:35:59.967072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07cb06-ff61-498b-83f5-24a4100e6f18 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:35:59.967072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07cb06-ff61-498b-83f5-24a4100e6f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:35:59.967072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-4f07cb06-ff61-498b-83f5-24a4100e6f18 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:35:59.967072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4f07cb06-ff61-498b-83f5-24a4100e6f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:00.068872 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 798/1608] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:35:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:00.078270 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ebdde-7782-45e3-b289-e6c46d1eed50 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:00.078578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ebdde-7782-45e3-b289-e6c46d1eed50 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:00.078862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ebdde-7782-45e3-b289-e6c46d1eed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:00.132445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-f95ebdde-7782-45e3-b289-e6c46d1eed50 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:00.136042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f95ebdde-7782-45e3-b289-e6c46d1eed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:00.148964 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74322ef2-0df9-4a68-b486-7eb9b8200e18 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:00.150018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74322ef2-0df9-4a68-b486-7eb9b8200e18 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:00.150454 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74322ef2-0df9-4a68-b486-7eb9b8200e18 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:00.161359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 799/1609] 10.222.0.16 () {54 vars in 912 bytes} [Sun Aug 29 14:36:00 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:36:00.165781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 811/1610] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:00.165919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74322ef2-0df9-4a68-b486-7eb9b8200e18 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:00.166042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340440ca-449e-484b-8901-daa1d6427f89 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:00.166042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340440ca-449e-484b-8901-daa1d6427f89 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:00.166042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340440ca-449e-484b-8901-daa1d6427f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:00.181202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74322ef2-0df9-4a68-b486-7eb9b8200e18 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:00.204381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757c3b-e22d-4d9b-a656-95b70f369ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:00.204554 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-340440ca-449e-484b-8901-daa1d6427f89 None None] MFA Rules not processed for user `f13a39de23f04cb0a2f5b050d740334a`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:00.205066 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757c3b-e22d-4d9b-a656-95b70f369ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:00.205515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757c3b-e22d-4d9b-a656-95b70f369ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:00.205681 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-340440ca-449e-484b-8901-daa1d6427f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:00.205782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757c3b-e22d-4d9b-a656-95b70f369ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:00.209345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71757c3b-e22d-4d9b-a656-95b70f369ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:36:00.209775 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71757c3b-e22d-4d9b-a656-95b70f369ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:00.211918 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71757c3b-e22d-4d9b-a656-95b70f369ca4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:00.247275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 800/1611] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:36:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:36:00.248648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757c3b-e22d-4d9b-a656-95b70f369ca4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:00.255825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-71757c3b-e22d-4d9b-a656-95b70f369ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:00.294660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757c3b-e22d-4d9b-a656-95b70f369ca4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:00.302774 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 812/1612] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:36:00 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:00.304027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340440ca-449e-484b-8901-daa1d6427f89 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:00.317489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340440ca-449e-484b-8901-daa1d6427f89 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:00.320554 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af823d-557e-46ae-a8fc-3f7e33bf146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:00.322163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af823d-557e-46ae-a8fc-3f7e33bf146f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:00.322163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af823d-557e-46ae-a8fc-3f7e33bf146f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:00.322439 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af823d-557e-46ae-a8fc-3f7e33bf146f admin admin] PATH_INFO: `/v3/users/afc9bdb75006427795bfc47937f9d6c0` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:00.327540 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af823d-557e-46ae-a8fc-3f7e33bf146f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc9bdb75006427795bfc47937f9d6c0)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:00.329844 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af823d-557e-46ae-a8fc-3f7e33bf146f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:00.339900 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a0332-3301-4df2-ab42-5d72c0af3d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:00.340799 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a0332-3301-4df2-ab42-5d72c0af3d3c admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:00.342523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a0332-3301-4df2-ab42-5d72c0af3d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:00.343191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a0332-3301-4df2-ab42-5d72c0af3d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:00.344723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a0332-3301-4df2-ab42-5d72c0af3d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:00.351056 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a0332-3301-4df2-ab42-5d72c0af3d3c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:00.500975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 813/1613] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:00 2021] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:00.502763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a0332-3301-4df2-ab42-5d72c0af3d3c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:00.525615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b48a0332-3301-4df2-ab42-5d72c0af3d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:00.669599 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-40af823d-557e-46ae-a8fc-3f7e33bf146f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc9bdb75006427795bfc47937f9d6c0'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:00.671272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-40af823d-557e-46ae-a8fc-3f7e33bf146f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc9bdb75006427795bfc47937f9d6c0'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:00.701657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-40af823d-557e-46ae-a8fc-3f7e33bf146f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc9bdb75006427795bfc47937f9d6c0'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:00.733526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a0332-3301-4df2-ab42-5d72c0af3d3c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:00.738170 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f94ad8-0a3b-4fb3-ac43-8f1266fc3c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:00.738997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f94ad8-0a3b-4fb3-ac43-8f1266fc3c9d service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:00.739307 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f94ad8-0a3b-4fb3-ac43-8f1266fc3c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:00.739576 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f94ad8-0a3b-4fb3-ac43-8f1266fc3c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:00.754958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f94ad8-0a3b-4fb3-ac43-8f1266fc3c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:00.756818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f94ad8-0a3b-4fb3-ac43-8f1266fc3c9d service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:00.769495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 814/1614] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:00 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:00.770722 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f94ad8-0a3b-4fb3-ac43-8f1266fc3c9d service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:00.772667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-40af823d-557e-46ae-a8fc-3f7e33bf146f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc9bdb75006427795bfc47937f9d6c0'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:00.810422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-40af823d-557e-46ae-a8fc-3f7e33bf146f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc9bdb75006427795bfc47937f9d6c0'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:00.844629 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 801/1615] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:00 2021] DELETE /identity/v3/users/afc9bdb75006427795bfc47937f9d6c0 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:00.846526 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35e3f-9c77-4462-90b6-9c4cd981d912 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:00.847467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35e3f-9c77-4462-90b6-9c4cd981d912 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:00.847907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35e3f-9c77-4462-90b6-9c4cd981d912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:00.895463 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-2af35e3f-9c77-4462-90b6-9c4cd981d912 None None] MFA Rules not processed for user `f13a39de23f04cb0a2f5b050d740334a`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:00.896946 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-2af35e3f-9c77-4462-90b6-9c4cd981d912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:00.984773 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 802/1616] 10.222.0.36 () {58 vars in 1016 bytes} [Sun Aug 29 14:36:00 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:01.043568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f94ad8-0a3b-4fb3-ac43-8f1266fc3c9d service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:01.190889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab4ce4-1d3b-425e-b9dd-a13cc5136f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:01.191750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab4ce4-1d3b-425e-b9dd-a13cc5136f1d admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:01.192143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab4ce4-1d3b-425e-b9dd-a13cc5136f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:01.192546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab4ce4-1d3b-425e-b9dd-a13cc5136f1d admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:01.193247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab4ce4-1d3b-425e-b9dd-a13cc5136f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:01.198523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab4ce4-1d3b-425e-b9dd-a13cc5136f1d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:01.199905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af35e3f-9c77-4462-90b6-9c4cd981d912 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:01.201555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-2af35e3f-9c77-4462-90b6-9c4cd981d912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:01.220909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af35e3f-9c77-4462-90b6-9c4cd981d912 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:01.237712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997aa84-c695-4cf6-bdeb-90bae0047e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:01.238437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997aa84-c695-4cf6-bdeb-90bae0047e36 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:01.239991 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997aa84-c695-4cf6-bdeb-90bae0047e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:01.240767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997aa84-c695-4cf6-bdeb-90bae0047e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:01.264287 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997aa84-c695-4cf6-bdeb-90bae0047e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:01.267851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997aa84-c695-4cf6-bdeb-90bae0047e36 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:01.293144 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 803/1617] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:01 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:36:01.316787 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 815/1618] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:00 2021] POST /identity/v3/users => generated 287 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:01.323825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997aa84-c695-4cf6-bdeb-90bae0047e36 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:01.326502 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8997aa84-c695-4cf6-bdeb-90bae0047e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:01.353955 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997aa84-c695-4cf6-bdeb-90bae0047e36 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:01.360478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c7e2f-f588-4194-b91c-a56c49aa383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:01.361242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c7e2f-f588-4194-b91c-a56c49aa383e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:01.361594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c7e2f-f588-4194-b91c-a56c49aa383e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:01.361973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c7e2f-f588-4194-b91c-a56c49aa383e admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:01.362770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c7e2f-f588-4194-b91c-a56c49aa383e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:01.364452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c7e2f-f588-4194-b91c-a56c49aa383e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:01.383537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 804/1619] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:01 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:01.388165 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab4ce4-1d3b-425e-b9dd-a13cc5136f1d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:01.402826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab4ce4-1d3b-425e-b9dd-a13cc5136f1d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:01.421816 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0043f8e-84b1-4229-9e99-7a6ccf6ea340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:01.422739 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0043f8e-84b1-4229-9e99-7a6ccf6ea340 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:01.423122 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0043f8e-84b1-4229-9e99-7a6ccf6ea340 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:01.423694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0043f8e-84b1-4229-9e99-7a6ccf6ea340 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:01.424530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0043f8e-84b1-4229-9e99-7a6ccf6ea340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:01.426980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0043f8e-84b1-4229-9e99-7a6ccf6ea340 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:01.430765 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c7e2f-f588-4194-b91c-a56c49aa383e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:01.435746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d99c7e2f-f588-4194-b91c-a56c49aa383e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:01.453184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 816/1620] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:01 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:01.457915 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0043f8e-84b1-4229-9e99-7a6ccf6ea340 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:01.485091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c7e2f-f588-4194-b91c-a56c49aa383e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:01.487100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0043f8e-84b1-4229-9e99-7a6ccf6ea340 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:01.496379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:01.497324 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:01.497613 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:01.497906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] PATH_INFO: `/v3/projects/55a1ad2f22c04639ad4b47574527b7a9` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:01.502119 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc90c2-b7d4-4c17-883e-f06bcbb82fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:01.502119 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc90c2-b7d4-4c17-883e-f06bcbb82fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:01.502119 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc90c2-b7d4-4c17-883e-f06bcbb82fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:01.502786 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a1ad2f22c04639ad4b47574527b7a9)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:01.502858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc90c2-b7d4-4c17-883e-f06bcbb82fe7 admin admin] PATH_INFO: `/v3/projects/e8c41c8dd0f345a0bf186dacbfc1077a/users/b3782c4fd65246e5827424a83005f2e5/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:01.508010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:01.562949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc90c2-b7d4-4c17-883e-f06bcbb82fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c41c8dd0f345a0bf186dacbfc1077a, user_id=b3782c4fd65246e5827424a83005f2e5, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:01.566278 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc90c2-b7d4-4c17-883e-f06bcbb82fe7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:01.881728 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 817/1621] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:01 2021] PUT /identity/v3/projects/e8c41c8dd0f345a0bf186dacbfc1077a/users/b3782c4fd65246e5827424a83005f2e5/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:01.903576 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c64fa-b9a9-449f-a4fa-e26581222a18 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:01.904514 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c64fa-b9a9-449f-a4fa-e26581222a18 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:01.904803 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c64fa-b9a9-449f-a4fa-e26581222a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:01.905185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a1ad2f22c04639ad4b47574527b7a9', 'request_id': 'req-686c857d-c475-4c78-bf85-a095254062b9'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:01.964474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-000c64fa-b9a9-449f-a4fa-e26581222a18 None None] MFA Rules not processed for user `b3782c4fd65246e5827424a83005f2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:01.968042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-000c64fa-b9a9-449f-a4fa-e26581222a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:02.090806 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 818/1622] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:01 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:02.217876 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a1ad2f22c04639ad4b47574527b7a9', 'request_id': 'req-686c857d-c475-4c78-bf85-a095254062b9'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:02.227148 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a1ad2f22c04639ad4b47574527b7a9', 'request_id': 'req-686c857d-c475-4c78-bf85-a095254062b9'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:02.283974 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] The token cache is being invalidate because project 55a1ad2f22c04639ad4b47574527b7a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:02.284228 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:02.285901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:02.287955 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 805/1623] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:01 2021] DELETE /identity/v3/projects/55a1ad2f22c04639ad4b47574527b7a9 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:02.315045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c64fa-b9a9-449f-a4fa-e26581222a18 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:02.463233 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c64fa-b9a9-449f-a4fa-e26581222a18 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:02.503933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815c95-b829-42b4-8207-6029a5d75686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:02.526172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815c95-b829-42b4-8207-6029a5d75686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:02.528075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815c95-b829-42b4-8207-6029a5d75686 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:02.529117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815c95-b829-42b4-8207-6029a5d75686 admin admin] PATH_INFO: `/v3/users/a13f9cc82a6e4278be92f467fc620e77` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:02.533886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03815c95-b829-42b4-8207-6029a5d75686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13f9cc82a6e4278be92f467fc620e77)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:02.542817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03815c95-b829-42b4-8207-6029a5d75686 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:02.685575 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:02.689272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:02.831791 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-03815c95-b829-42b4-8207-6029a5d75686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13f9cc82a6e4278be92f467fc620e77'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:02.832975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-03815c95-b829-42b4-8207-6029a5d75686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13f9cc82a6e4278be92f467fc620e77'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:02.833610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-03815c95-b829-42b4-8207-6029a5d75686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13f9cc82a6e4278be92f467fc620e77'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:02.851299 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c857d-c475-4c78-bf85-a095254062b9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:02.865489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4b374-0336-47a6-9075-c0009df931c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:02.876506 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b374-0336-47a6-9075-c0009df931c0 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:02.877141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b374-0336-47a6-9075-c0009df931c0 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:02.877717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b374-0336-47a6-9075-c0009df931c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:02.880682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-2db4b374-0336-47a6-9075-c0009df931c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:02.897244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4b374-0336-47a6-9075-c0009df931c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:02.900428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4b374-0336-47a6-9075-c0009df931c0 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:02.924638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 806/1624] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:02 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:02.947709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-03815c95-b829-42b4-8207-6029a5d75686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13f9cc82a6e4278be92f467fc620e77'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:02.979851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-03815c95-b829-42b4-8207-6029a5d75686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13f9cc82a6e4278be92f467fc620e77'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:03.021228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 819/1625] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:02 2021] DELETE /identity/v3/users/a13f9cc82a6e4278be92f467fc620e77 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:03.694666 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4b374-0336-47a6-9075-c0009df931c0 service nova] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:03.699198 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-2db4b374-0336-47a6-9075-c0009df931c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:03.727779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4b374-0336-47a6-9075-c0009df931c0 service nova] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:03.864553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce06eae-ad3e-4771-922a-dc26a5fc6072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:03.865449 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce06eae-ad3e-4771-922a-dc26a5fc6072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:03.865810 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce06eae-ad3e-4771-922a-dc26a5fc6072 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:03.881776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce06eae-ad3e-4771-922a-dc26a5fc6072 admin admin] PATH_INFO: `/v3/projects/c0faa41a0a6f47918344c4d923599733` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:03.885519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fe2c3-a0c2-414a-8b0d-1708d80c45d8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:03.887796 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fe2c3-a0c2-414a-8b0d-1708d80c45d8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:03.887796 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fe2c3-a0c2-414a-8b0d-1708d80c45d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:03.897940 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce06eae-ad3e-4771-922a-dc26a5fc6072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0faa41a0a6f47918344c4d923599733)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:03.908909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce06eae-ad3e-4771-922a-dc26a5fc6072 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:03.938948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-466fe2c3-a0c2-414a-8b0d-1708d80c45d8 None None] MFA Rules not processed for user `f44dac86674e41b78375a51798ea0cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:03.944771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-466fe2c3-a0c2-414a-8b0d-1708d80c45d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:04.087700 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 820/1626] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:03 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:04.183424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-fce06eae-ad3e-4771-922a-dc26a5fc6072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0faa41a0a6f47918344c4d923599733', 'request_id': 'req-fce06eae-ad3e-4771-922a-dc26a5fc6072'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:04.305065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-fce06eae-ad3e-4771-922a-dc26a5fc6072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0faa41a0a6f47918344c4d923599733', 'request_id': 'req-fce06eae-ad3e-4771-922a-dc26a5fc6072'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:04.313492 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-fce06eae-ad3e-4771-922a-dc26a5fc6072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0faa41a0a6f47918344c4d923599733', 'request_id': 'req-fce06eae-ad3e-4771-922a-dc26a5fc6072'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:04.331730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f0bb-02e5-4a30-959e-0fea8846c4a5 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:04.331977 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f0bb-02e5-4a30-959e-0fea8846c4a5 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:04.332434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f0bb-02e5-4a30-959e-0fea8846c4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:04.356351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-fce06eae-ad3e-4771-922a-dc26a5fc6072 admin admin] The token cache is being invalidate because project c0faa41a0a6f47918344c4d923599733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:04.361176 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-fce06eae-ad3e-4771-922a-dc26a5fc6072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:04.365369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-fce06eae-ad3e-4771-922a-dc26a5fc6072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:04.377216 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 807/1627] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:03 2021] DELETE /identity/v3/projects/c0faa41a0a6f47918344c4d923599733 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:04.381306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d147e63-66da-49fd-a9c5-90fd3b2332d6 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:04.389325 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d147e63-66da-49fd-a9c5-90fd3b2332d6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:04.389325 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d147e63-66da-49fd-a9c5-90fd3b2332d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:04.410214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-ae22f0bb-02e5-4a30-959e-0fea8846c4a5 None None] MFA Rules not processed for user `c60cd9a36fad47d98458b8c0e28f3ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:04.411428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ae22f0bb-02e5-4a30-959e-0fea8846c4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:04.424931 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-5d147e63-66da-49fd-a9c5-90fd3b2332d6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:04.429408 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5d147e63-66da-49fd-a9c5-90fd3b2332d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:04.584081 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 808/1628] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:04.594289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8661-acf4-4a50-b848-d0236edc545d None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:04.594289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8661-acf4-4a50-b848-d0236edc545d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:04.594289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8661-acf4-4a50-b848-d0236edc545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:04.595311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 821/1629] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:04 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:04.631387 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-cc2d8661-acf4-4a50-b848-d0236edc545d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:04.632893 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-cc2d8661-acf4-4a50-b848-d0236edc545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:04.652162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 809/1630] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:04.653763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22f0bb-02e5-4a30-959e-0fea8846c4a5 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:04.668636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22f0bb-02e5-4a30-959e-0fea8846c4a5 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:04.674435 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af672a-fb81-4d24-b0d7-48225e28748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:04.675460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af672a-fb81-4d24-b0d7-48225e28748a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:04.677044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af672a-fb81-4d24-b0d7-48225e28748a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:04.677813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af672a-fb81-4d24-b0d7-48225e28748a admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:04.679069 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af672a-fb81-4d24-b0d7-48225e28748a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:36:04.679766 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af672a-fb81-4d24-b0d7-48225e28748a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:04.683428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af672a-fb81-4d24-b0d7-48225e28748a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:04.704788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 822/1631] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:36:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:36:04.709213 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8661-acf4-4a50-b848-d0236edc545d None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:04.720370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8661-acf4-4a50-b848-d0236edc545d None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:04.733588 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43de77e-04ef-4dcb-bd35-13126f704e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:04.736040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43de77e-04ef-4dcb-bd35-13126f704e45 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:04.736540 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43de77e-04ef-4dcb-bd35-13126f704e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:04.736965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43de77e-04ef-4dcb-bd35-13126f704e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:04.737843 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43de77e-04ef-4dcb-bd35-13126f704e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:04.740254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43de77e-04ef-4dcb-bd35-13126f704e45 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:04.896500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 810/1632] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:04 2021] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:04.898144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af672a-fb81-4d24-b0d7-48225e28748a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:04.911807 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af672a-fb81-4d24-b0d7-48225e28748a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:05.072156 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed0f20-c8e8-4e94-8432-5b7d5cc8cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:05.074151 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed0f20-c8e8-4e94-8432-5b7d5cc8cd41 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:05.074795 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed0f20-c8e8-4e94-8432-5b7d5cc8cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:05.075384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed0f20-c8e8-4e94-8432-5b7d5cc8cd41 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:05.076399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed0f20-c8e8-4e94-8432-5b7d5cc8cd41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:05.079279 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed0f20-c8e8-4e94-8432-5b7d5cc8cd41 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:05.204022 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 823/1633] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:04 2021] POST /identity/v3/users => generated 290 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:05.210279 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43de77e-04ef-4dcb-bd35-13126f704e45 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:05.242018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43de77e-04ef-4dcb-bd35-13126f704e45 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:05.270566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b39d3-a724-466d-bca6-3258317aafb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:05.275933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b39d3-a724-466d-bca6-3258317aafb0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:05.275933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b39d3-a724-466d-bca6-3258317aafb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:05.275933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b39d3-a724-466d-bca6-3258317aafb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:05.275933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b39d3-a724-466d-bca6-3258317aafb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:05.280146 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b39d3-a724-466d-bca6-3258317aafb0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:05.313220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 811/1634] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:05 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:05.314484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed0f20-c8e8-4e94-8432-5b7d5cc8cd41 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:05.338295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed0f20-c8e8-4e94-8432-5b7d5cc8cd41 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:05.348316 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e5529-ff22-4865-a590-c652a3be58e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:05.348513 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e5529-ff22-4865-a590-c652a3be58e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:05.349189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e5529-ff22-4865-a590-c652a3be58e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:05.349619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e5529-ff22-4865-a590-c652a3be58e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:05.364336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e5529-ff22-4865-a590-c652a3be58e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:05.366304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e5529-ff22-4865-a590-c652a3be58e6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:05.413024 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 824/1635] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:05 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:05.414949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b39d3-a724-466d-bca6-3258317aafb0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:05.439448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b39d3-a724-466d-bca6-3258317aafb0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:05.453599 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633f4af-1f58-420e-af85-2288beb440f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:05.455614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633f4af-1f58-420e-af85-2288beb440f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:05.457310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633f4af-1f58-420e-af85-2288beb440f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:05.457788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633f4af-1f58-420e-af85-2288beb440f7 admin admin] PATH_INFO: `/v3/projects/955cb829e51842bf9b6e03d0badcfe0b/users/7a5d9009e23e421f8e2bfb5d3e591a77/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:05.483014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633f4af-1f58-420e-af85-2288beb440f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955cb829e51842bf9b6e03d0badcfe0b, user_id=7a5d9009e23e421f8e2bfb5d3e591a77, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:05.486898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633f4af-1f58-420e-af85-2288beb440f7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:05.596047 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 812/1636] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:05 2021] PUT /identity/v3/projects/955cb829e51842bf9b6e03d0badcfe0b/users/7a5d9009e23e421f8e2bfb5d3e591a77/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:36:05.658374 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058150d-745f-4877-b933-4b6c7d4dbdf1 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:05.683255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058150d-745f-4877-b933-4b6c7d4dbdf1 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:05.683255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058150d-745f-4877-b933-4b6c7d4dbdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:05.704869 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-9058150d-745f-4877-b933-4b6c7d4dbdf1 None None] MFA Rules not processed for user `7a5d9009e23e421f8e2bfb5d3e591a77`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:05.706826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-9058150d-745f-4877-b933-4b6c7d4dbdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:05.797617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 825/1637] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:05 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:05.807717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633f4af-1f58-420e-af85-2288beb440f7 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:05.896515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633f4af-1f58-420e-af85-2288beb440f7 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:05.902763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00501276-8333-489e-969f-97988a47b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:05.903570 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00501276-8333-489e-969f-97988a47b42a admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:05.903929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00501276-8333-489e-969f-97988a47b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:05.904282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00501276-8333-489e-969f-97988a47b42a admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:05.905122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00501276-8333-489e-969f-97988a47b42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:05.908185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00501276-8333-489e-969f-97988a47b42a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:06.219844 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058150d-745f-4877-b933-4b6c7d4dbdf1 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:06.221970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-9058150d-745f-4877-b933-4b6c7d4dbdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:06.327790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 813/1638] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:05 2021] POST /identity/v3/projects => generated 379 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:06.329668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00501276-8333-489e-969f-97988a47b42a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:06.335405 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058150d-745f-4877-b933-4b6c7d4dbdf1 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:06.495363 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89295d37-1fb3-4522-bf81-ee97d85cd044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:06.496428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89295d37-1fb3-4522-bf81-ee97d85cd044 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:06.498531 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89295d37-1fb3-4522-bf81-ee97d85cd044 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:06.499178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89295d37-1fb3-4522-bf81-ee97d85cd044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:06.562843 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00501276-8333-489e-969f-97988a47b42a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:06.598729 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86681e-6426-44fc-802e-1b833b942bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:06.601650 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86681e-6426-44fc-802e-1b833b942bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:06.607956 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86681e-6426-44fc-802e-1b833b942bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:06.607956 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86681e-6426-44fc-802e-1b833b942bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:06.607956 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86681e-6426-44fc-802e-1b833b942bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:06.617234 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86681e-6426-44fc-802e-1b833b942bb5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:06.692861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89295d37-1fb3-4522-bf81-ee97d85cd044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:06.696560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89295d37-1fb3-4522-bf81-ee97d85cd044 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:06.715383 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 826/1639] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:06 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:06.717130 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656c12c-58d2-44d4-8d44-d35d900bdf6c None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:06.717463 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656c12c-58d2-44d4-8d44-d35d900bdf6c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:06.717773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656c12c-58d2-44d4-8d44-d35d900bdf6c None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:06.720864 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 827/1640] 10.222.0.16 () {54 vars in 921 bytes} [Sun Aug 29 14:36:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:36:06.747149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d054666-0f83-4d74-a6f0-8df39aaae368 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:06.747665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d054666-0f83-4d74-a6f0-8df39aaae368 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:06.748128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d054666-0f83-4d74-a6f0-8df39aaae368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:06.785927 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0d054666-0f83-4d74-a6f0-8df39aaae368 None None] MFA Rules not processed for user `d8c0afa8f09f4923b9c8ab2696156129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:06.788044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0d054666-0f83-4d74-a6f0-8df39aaae368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:06.802879 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 828/1641] 10.222.0.16 () {58 vars in 1019 bytes} [Sun Aug 29 14:36:06 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:06.877002 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 814/1642] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:06 2021] POST /identity/v3/users => generated 296 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:06.878509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d054666-0f83-4d74-a6f0-8df39aaae368 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:06.893520 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d054666-0f83-4d74-a6f0-8df39aaae368 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:06.903203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98e442-12b0-44b5-8f65-82ef3e43df97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:06.904310 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98e442-12b0-44b5-8f65-82ef3e43df97 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:06.904839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98e442-12b0-44b5-8f65-82ef3e43df97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:06.905161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98e442-12b0-44b5-8f65-82ef3e43df97 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:06.906053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98e442-12b0-44b5-8f65-82ef3e43df97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:06.907756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98e442-12b0-44b5-8f65-82ef3e43df97 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:06.922848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 829/1643] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:06 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:06.925021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86681e-6426-44fc-802e-1b833b942bb5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:06.945248 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86681e-6426-44fc-802e-1b833b942bb5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:06.962240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed2b59-7e05-4d70-9d5b-74781c79df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:06.962240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed2b59-7e05-4d70-9d5b-74781c79df0b admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:06.962240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed2b59-7e05-4d70-9d5b-74781c79df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:06.962240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed2b59-7e05-4d70-9d5b-74781c79df0b admin admin] PATH_INFO: `/v3/projects/94b8d14b56094551b2c39f1cf6c20d14/users/fcb2d82ab5124646aaeda562546b4cfd/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:07.010110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed2b59-7e05-4d70-9d5b-74781c79df0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b8d14b56094551b2c39f1cf6c20d14, user_id=fcb2d82ab5124646aaeda562546b4cfd, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:07.024977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed2b59-7e05-4d70-9d5b-74781c79df0b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:07.308169 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 815/1644] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:06 2021] PUT /identity/v3/projects/94b8d14b56094551b2c39f1cf6c20d14/users/fcb2d82ab5124646aaeda562546b4cfd/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:07.309644 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98e442-12b0-44b5-8f65-82ef3e43df97 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:07.327896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98e442-12b0-44b5-8f65-82ef3e43df97 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:07.527927 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1524af-e6b1-4644-b65a-8a7617820f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:07.530145 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1524af-e6b1-4644-b65a-8a7617820f43 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:07.533030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1524af-e6b1-4644-b65a-8a7617820f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:07.533030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1524af-e6b1-4644-b65a-8a7617820f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:07.533030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1524af-e6b1-4644-b65a-8a7617820f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:07.539808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1524af-e6b1-4644-b65a-8a7617820f43 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:07.576277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 830/1645] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:07 2021] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:36:07.579740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed2b59-7e05-4d70-9d5b-74781c79df0b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:07.598070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed2b59-7e05-4d70-9d5b-74781c79df0b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:07.635313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cefc3e-11e6-4704-bad3-e3ec9bc2b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:07.644355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1524af-e6b1-4644-b65a-8a7617820f43 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:07.666550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cefc3e-11e6-4704-bad3-e3ec9bc2b7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:07.666550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cefc3e-11e6-4704-bad3-e3ec9bc2b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:07.666550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cefc3e-11e6-4704-bad3-e3ec9bc2b7c1 admin admin] PATH_INFO: `/v3/projects/94b8d14b56094551b2c39f1cf6c20d14/users/fcb2d82ab5124646aaeda562546b4cfd/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:07.667709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cefc3e-11e6-4704-bad3-e3ec9bc2b7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b8d14b56094551b2c39f1cf6c20d14, user_id=fcb2d82ab5124646aaeda562546b4cfd, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:07.677099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cefc3e-11e6-4704-bad3-e3ec9bc2b7c1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:07.728748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 816/1646] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:07 2021] PUT /identity/v3/projects/94b8d14b56094551b2c39f1cf6c20d14/users/fcb2d82ab5124646aaeda562546b4cfd/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:36:07.734163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57bb7-e4a7-4db0-a96e-960307507cb4 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:07.734459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57bb7-e4a7-4db0-a96e-960307507cb4 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:07.734845 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57bb7-e4a7-4db0-a96e-960307507cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:07.833626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e3d57bb7-e4a7-4db0-a96e-960307507cb4 None None] MFA Rules not processed for user `fcb2d82ab5124646aaeda562546b4cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:07.838477 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e3d57bb7-e4a7-4db0-a96e-960307507cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:07.918532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1524af-e6b1-4644-b65a-8a7617820f43 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:08.067303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 817/1647] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:07 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:08.080953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57bb7-e4a7-4db0-a96e-960307507cb4 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:08.137461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94363fe3-38e6-4a8e-93cd-57af0d210a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:08.137461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94363fe3-38e6-4a8e-93cd-57af0d210a4d service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:08.137461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94363fe3-38e6-4a8e-93cd-57af0d210a4d service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:08.137461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94363fe3-38e6-4a8e-93cd-57af0d210a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:08.137766 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94363fe3-38e6-4a8e-93cd-57af0d210a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:08.137766 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94363fe3-38e6-4a8e-93cd-57af0d210a4d service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:08.163477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 831/1648] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:08.235027 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57bb7-e4a7-4db0-a96e-960307507cb4 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:08.260873 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441bbf4-f924-476e-900c-c11a732fa9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:08.261791 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441bbf4-f924-476e-900c-c11a732fa9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:08.262096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441bbf4-f924-476e-900c-c11a732fa9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:08.262370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441bbf4-f924-476e-900c-c11a732fa9a4 admin admin] PATH_INFO: `/v3/users/7a5d9009e23e421f8e2bfb5d3e591a77` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:08.268566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441bbf4-f924-476e-900c-c11a732fa9a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5d9009e23e421f8e2bfb5d3e591a77)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:08.272840 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441bbf4-f924-476e-900c-c11a732fa9a4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:08.763168 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-2441bbf4-f924-476e-900c-c11a732fa9a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5d9009e23e421f8e2bfb5d3e591a77'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:08.764756 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-2441bbf4-f924-476e-900c-c11a732fa9a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5d9009e23e421f8e2bfb5d3e591a77'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:08.780972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-2441bbf4-f924-476e-900c-c11a732fa9a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5d9009e23e421f8e2bfb5d3e591a77'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:08.884710 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-2441bbf4-f924-476e-900c-c11a732fa9a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5d9009e23e421f8e2bfb5d3e591a77'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:08.915440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-2441bbf4-f924-476e-900c-c11a732fa9a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5d9009e23e421f8e2bfb5d3e591a77'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:08.946739 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 818/1649] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:08 2021] DELETE /identity/v3/users/7a5d9009e23e421f8e2bfb5d3e591a77 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:08.951745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235aaf6b-2461-4bb6-92e6-ee27c649242c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:08.953220 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235aaf6b-2461-4bb6-92e6-ee27c649242c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:08.954206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235aaf6b-2461-4bb6-92e6-ee27c649242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:08.984185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf486df-f314-4ef7-afc9-0eed2a90a616 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:08.984484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf486df-f314-4ef7-afc9-0eed2a90a616 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:08.984770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf486df-f314-4ef7-afc9-0eed2a90a616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:09.056891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-235aaf6b-2461-4bb6-92e6-ee27c649242c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:09.062618 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-235aaf6b-2461-4bb6-92e6-ee27c649242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:09.074868 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-7bf486df-f314-4ef7-afc9-0eed2a90a616 None None] MFA Rules not processed for user `304ebf23ad9c47eeba8baec42e096a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:09.078614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7bf486df-f314-4ef7-afc9-0eed2a90a616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:09.260006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 832/1650] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:09.287968 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235aaf6b-2461-4bb6-92e6-ee27c649242c None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:09.290486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-235aaf6b-2461-4bb6-92e6-ee27c649242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:09.308361 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 819/1651] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:08 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:09.417457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf486df-f314-4ef7-afc9-0eed2a90a616 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:09.421595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7bf486df-f314-4ef7-afc9-0eed2a90a616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:09.503417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235aaf6b-2461-4bb6-92e6-ee27c649242c None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:09.528507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b80db0-7b79-4ffd-9133-a3a52fb68e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:09.529192 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b80db0-7b79-4ffd-9133-a3a52fb68e0d service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:09.529474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b80db0-7b79-4ffd-9133-a3a52fb68e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:09.529751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b80db0-7b79-4ffd-9133-a3a52fb68e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:09.559622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b80db0-7b79-4ffd-9133-a3a52fb68e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:09.564820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b80db0-7b79-4ffd-9133-a3a52fb68e0d service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:09.580629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 833/1652] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:09.619194 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf486df-f314-4ef7-afc9-0eed2a90a616 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:09.635136 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0dc21-53fa-4fa1-b6cf-1a68e7717be5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:09.635820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0dc21-53fa-4fa1-b6cf-1a68e7717be5 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:09.636111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0dc21-53fa-4fa1-b6cf-1a68e7717be5 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:09.636404 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0dc21-53fa-4fa1-b6cf-1a68e7717be5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:09.688677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0dc21-53fa-4fa1-b6cf-1a68e7717be5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:09.690388 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0dc21-53fa-4fa1-b6cf-1a68e7717be5 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:09.740869 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 820/1653] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:09 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:36:09.896551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b80db0-7b79-4ffd-9133-a3a52fb68e0d service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:09.898388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a7b80db0-7b79-4ffd-9133-a3a52fb68e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:09.958302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b80db0-7b79-4ffd-9133-a3a52fb68e0d service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:09.974540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:09.978758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:09.979858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:09.980604 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] PATH_INFO: `/v3/users/b3782c4fd65246e5827424a83005f2e5` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:09.982863 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3782c4fd65246e5827424a83005f2e5)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:09.995621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:10.545173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3782c4fd65246e5827424a83005f2e5'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:10.546592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3782c4fd65246e5827424a83005f2e5'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:10.551808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3782c4fd65246e5827424a83005f2e5'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:10.658849 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3782c4fd65246e5827424a83005f2e5'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:10.691375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3782c4fd65246e5827424a83005f2e5'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:10.712058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 834/1654] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:09 2021] DELETE /identity/v3/users/b3782c4fd65246e5827424a83005f2e5 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:10.713485 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9b2c-82d4-48b2-8dd8-59039fc6fbe6 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:10.724965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9b2c-82d4-48b2-8dd8-59039fc6fbe6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:10.724965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9b2c-82d4-48b2-8dd8-59039fc6fbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:10.737685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-4f5d9b2c-82d4-48b2-8dd8-59039fc6fbe6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:10.738992 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4f5d9b2c-82d4-48b2-8dd8-59039fc6fbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:10.907107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 821/1655] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:11.001751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:11.003196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:11.078557 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49830879-790e-4ea6-b0c8-269d14b35bbc admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:11.082830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b12ce0-ed29-45b7-aa8d-a48cea90e229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:11.092587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12ce0-ed29-45b7-aa8d-a48cea90e229 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:11.092587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12ce0-ed29-45b7-aa8d-a48cea90e229 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:11.092587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12ce0-ed29-45b7-aa8d-a48cea90e229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:11.094519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b12ce0-ed29-45b7-aa8d-a48cea90e229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:11.095755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b12ce0-ed29-45b7-aa8d-a48cea90e229 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:11.108945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 835/1656] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:12.041558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d9b2c-82d4-48b2-8dd8-59039fc6fbe6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:12.043255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4f5d9b2c-82d4-48b2-8dd8-59039fc6fbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:12.063427 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d9b2c-82d4-48b2-8dd8-59039fc6fbe6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:12.092073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b53c5a-eb78-4933-8368-ef4150cc3ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:12.101905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53c5a-eb78-4933-8368-ef4150cc3ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:12.104315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53c5a-eb78-4933-8368-ef4150cc3ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:12.104731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53c5a-eb78-4933-8368-ef4150cc3ed0 admin admin] PATH_INFO: `/v3/projects/955cb829e51842bf9b6e03d0badcfe0b` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:12.111415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b53c5a-eb78-4933-8368-ef4150cc3ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955cb829e51842bf9b6e03d0badcfe0b)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:12.117824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b53c5a-eb78-4933-8368-ef4150cc3ed0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:12.298990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-79b53c5a-eb78-4933-8368-ef4150cc3ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955cb829e51842bf9b6e03d0badcfe0b', 'request_id': 'req-79b53c5a-eb78-4933-8368-ef4150cc3ed0'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:12.399544 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-79b53c5a-eb78-4933-8368-ef4150cc3ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955cb829e51842bf9b6e03d0badcfe0b', 'request_id': 'req-79b53c5a-eb78-4933-8368-ef4150cc3ed0'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:12.400661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-79b53c5a-eb78-4933-8368-ef4150cc3ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955cb829e51842bf9b6e03d0badcfe0b', 'request_id': 'req-79b53c5a-eb78-4933-8368-ef4150cc3ed0'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:12.419141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-79b53c5a-eb78-4933-8368-ef4150cc3ed0 admin admin] The token cache is being invalidate because project 955cb829e51842bf9b6e03d0badcfe0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:12.419521 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-79b53c5a-eb78-4933-8368-ef4150cc3ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:12.420280 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-79b53c5a-eb78-4933-8368-ef4150cc3ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:12.422093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 822/1657] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:12 2021] DELETE /identity/v3/projects/955cb829e51842bf9b6e03d0badcfe0b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:12.426531 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b12ce0-ed29-45b7-aa8d-a48cea90e229 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:12.449025 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b12ce0-ed29-45b7-aa8d-a48cea90e229 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:12.522180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379a264-493d-4551-99da-598674d2c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:12.523330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a264-493d-4551-99da-598674d2c1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:12.523780 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a264-493d-4551-99da-598674d2c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:12.524241 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a264-493d-4551-99da-598674d2c1ad admin admin] PATH_INFO: `/v3/users/fcb2d82ab5124646aaeda562546b4cfd` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:12.525700 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379a264-493d-4551-99da-598674d2c1ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb2d82ab5124646aaeda562546b4cfd)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:12.528285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379a264-493d-4551-99da-598674d2c1ad admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:12.760832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-2379a264-493d-4551-99da-598674d2c1ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb2d82ab5124646aaeda562546b4cfd'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:12.762057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-2379a264-493d-4551-99da-598674d2c1ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb2d82ab5124646aaeda562546b4cfd'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:12.762891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-2379a264-493d-4551-99da-598674d2c1ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb2d82ab5124646aaeda562546b4cfd'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:12.844182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-2379a264-493d-4551-99da-598674d2c1ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb2d82ab5124646aaeda562546b4cfd'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:12.862346 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-2379a264-493d-4551-99da-598674d2c1ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb2d82ab5124646aaeda562546b4cfd'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:12.890815 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 836/1658] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:12 2021] DELETE /identity/v3/users/fcb2d82ab5124646aaeda562546b4cfd => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:36:13.189448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88310dbe-e047-4abf-aadf-4f69b16870ab None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:13.193110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88310dbe-e047-4abf-aadf-4f69b16870ab None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:13.193396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88310dbe-e047-4abf-aadf-4f69b16870ab None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:13.199522 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 823/1659] 10.222.0.16 () {54 vars in 921 bytes} [Sun Aug 29 14:36:13 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:36:13.208325 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a952457-6d22-4c2f-8821-14e7134d3d73 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:13.208872 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a952457-6d22-4c2f-8821-14e7134d3d73 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:13.209359 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a952457-6d22-4c2f-8821-14e7134d3d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:13.244978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-8a952457-6d22-4c2f-8821-14e7134d3d73 None None] MFA Rules not processed for user `d8c0afa8f09f4923b9c8ab2696156129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:13.247472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8a952457-6d22-4c2f-8821-14e7134d3d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:13.334001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 837/1660] 10.222.0.16 () {58 vars in 1019 bytes} [Sun Aug 29 14:36:13 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:13.366116 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88310dbe-e047-4abf-aadf-4f69b16870ab None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:13.369303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-88310dbe-e047-4abf-aadf-4f69b16870ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:13.392972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88310dbe-e047-4abf-aadf-4f69b16870ab None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:13.401891 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404790b0-3bf6-40e3-8922-7904f931a596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:13.404086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404790b0-3bf6-40e3-8922-7904f931a596 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:13.404648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404790b0-3bf6-40e3-8922-7904f931a596 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:13.405093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404790b0-3bf6-40e3-8922-7904f931a596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:13.416929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404790b0-3bf6-40e3-8922-7904f931a596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:13.418911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404790b0-3bf6-40e3-8922-7904f931a596 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:13.431454 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 824/1661] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:13 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:13.626876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a952457-6d22-4c2f-8821-14e7134d3d73 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:13.629157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8a952457-6d22-4c2f-8821-14e7134d3d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:13.764554 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a952457-6d22-4c2f-8821-14e7134d3d73 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:13.770087 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e89a99-2006-4c32-bfe7-e5342edc933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:13.771053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e89a99-2006-4c32-bfe7-e5342edc933c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:13.771340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e89a99-2006-4c32-bfe7-e5342edc933c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:13.771665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e89a99-2006-4c32-bfe7-e5342edc933c admin admin] PATH_INFO: `/v3/projects/e8c41c8dd0f345a0bf186dacbfc1077a` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:13.773017 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e89a99-2006-4c32-bfe7-e5342edc933c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c41c8dd0f345a0bf186dacbfc1077a)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:13.776205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e89a99-2006-4c32-bfe7-e5342edc933c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:13.796212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404790b0-3bf6-40e3-8922-7904f931a596 service nova] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:13.797824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-404790b0-3bf6-40e3-8922-7904f931a596 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:13.817763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404790b0-3bf6-40e3-8922-7904f931a596 service nova] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:13.824244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd37d6-a0da-48f9-9cc5-688a384c31ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:13.825368 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd37d6-a0da-48f9-9cc5-688a384c31ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:13.825811 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd37d6-a0da-48f9-9cc5-688a384c31ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:13.826262 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd37d6-a0da-48f9-9cc5-688a384c31ed admin admin] PATH_INFO: `/v3/users/d051f967ac9a412c82791a17b0dc7248` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:13.827696 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd37d6-a0da-48f9-9cc5-688a384c31ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d051f967ac9a412c82791a17b0dc7248)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:13.829767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd37d6-a0da-48f9-9cc5-688a384c31ed admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:13.927551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-99e89a99-2006-4c32-bfe7-e5342edc933c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c41c8dd0f345a0bf186dacbfc1077a', 'request_id': 'req-99e89a99-2006-4c32-bfe7-e5342edc933c'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.029403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-99e89a99-2006-4c32-bfe7-e5342edc933c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c41c8dd0f345a0bf186dacbfc1077a', 'request_id': 'req-99e89a99-2006-4c32-bfe7-e5342edc933c'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.037077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-99e89a99-2006-4c32-bfe7-e5342edc933c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c41c8dd0f345a0bf186dacbfc1077a', 'request_id': 'req-99e89a99-2006-4c32-bfe7-e5342edc933c'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.053103 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-99e89a99-2006-4c32-bfe7-e5342edc933c admin admin] The token cache is being invalidate because project e8c41c8dd0f345a0bf186dacbfc1077a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:14.053420 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-99e89a99-2006-4c32-bfe7-e5342edc933c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.054203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-99e89a99-2006-4c32-bfe7-e5342edc933c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.058141 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 838/1662] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:13 2021] DELETE /identity/v3/projects/e8c41c8dd0f345a0bf186dacbfc1077a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:14.068533 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460366d9-ef7f-49c8-b321-c082d4a7af92 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:14.068845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460366d9-ef7f-49c8-b321-c082d4a7af92 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:14.069128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460366d9-ef7f-49c8-b321-c082d4a7af92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:14.101631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-460366d9-ef7f-49c8-b321-c082d4a7af92 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:14.103054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-460366d9-ef7f-49c8-b321-c082d4a7af92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:14.104960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-30cd37d6-a0da-48f9-9cc5-688a384c31ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd051f967ac9a412c82791a17b0dc7248'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.106091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-30cd37d6-a0da-48f9-9cc5-688a384c31ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd051f967ac9a412c82791a17b0dc7248'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.119474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-30cd37d6-a0da-48f9-9cc5-688a384c31ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd051f967ac9a412c82791a17b0dc7248'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.184548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 839/1663] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:14.233037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae195e-90f0-4b4d-b9c4-461e0facf6df None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:14.233362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae195e-90f0-4b4d-b9c4-461e0facf6df None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:14.233652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae195e-90f0-4b4d-b9c4-461e0facf6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:14.246470 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-30cd37d6-a0da-48f9-9cc5-688a384c31ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd051f967ac9a412c82791a17b0dc7248'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.263874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-29ae195e-90f0-4b4d-b9c4-461e0facf6df None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:14.265451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-29ae195e-90f0-4b4d-b9c4-461e0facf6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:14.267281 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-30cd37d6-a0da-48f9-9cc5-688a384c31ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd051f967ac9a412c82791a17b0dc7248'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.278564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 840/1665] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:14.278564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae195e-90f0-4b4d-b9c4-461e0facf6df None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:14.280177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 825/1665] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:13 2021] DELETE /identity/v3/users/d051f967ac9a412c82791a17b0dc7248 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:14.281809 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6228daa-9730-450a-a813-7c39048e6cf5 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:14.282141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6228daa-9730-450a-a813-7c39048e6cf5 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:14.282422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6228daa-9730-450a-a813-7c39048e6cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:14.290170 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae195e-90f0-4b4d-b9c4-461e0facf6df None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:14.325732 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e6228daa-9730-450a-a813-7c39048e6cf5 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:14.330015 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e6228daa-9730-450a-a813-7c39048e6cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:14.390790 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa388450-e53a-48d1-a74a-596ff5f9fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:14.392768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388450-e53a-48d1-a74a-596ff5f9fe34 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:14.393039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388450-e53a-48d1-a74a-596ff5f9fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:14.393462 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388450-e53a-48d1-a74a-596ff5f9fe34 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:14.394140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa388450-e53a-48d1-a74a-596ff5f9fe34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:36:14.394450 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa388450-e53a-48d1-a74a-596ff5f9fe34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:14.396186 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa388450-e53a-48d1-a74a-596ff5f9fe34 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:14.407904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 826/1666] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:14.407904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6228daa-9730-450a-a813-7c39048e6cf5 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:14.407904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e6228daa-9730-450a-a813-7c39048e6cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:14.421891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 841/1667] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:36:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:36:14.421891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa388450-e53a-48d1-a74a-596ff5f9fe34 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:14.423033 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-aa388450-e53a-48d1-a74a-596ff5f9fe34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:14.426600 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6228daa-9730-450a-a813-7c39048e6cf5 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:14.432253 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fdf23-20f5-4f8e-9237-89bb00265e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:14.438954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fdf23-20f5-4f8e-9237-89bb00265e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:14.444915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fdf23-20f5-4f8e-9237-89bb00265e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:14.444915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fdf23-20f5-4f8e-9237-89bb00265e47 admin admin] PATH_INFO: `/v3/projects/94b8d14b56094551b2c39f1cf6c20d14` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:14.444915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fdf23-20f5-4f8e-9237-89bb00265e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b8d14b56094551b2c39f1cf6c20d14)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:14.444915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fdf23-20f5-4f8e-9237-89bb00265e47 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:14.537707 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa388450-e53a-48d1-a74a-596ff5f9fe34 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:14.542678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce1f88-022e-4484-804f-32d113a5ca37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:14.543382 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce1f88-022e-4484-804f-32d113a5ca37 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:14.543758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce1f88-022e-4484-804f-32d113a5ca37 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:14.544104 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce1f88-022e-4484-804f-32d113a5ca37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:14.555168 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce1f88-022e-4484-804f-32d113a5ca37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:14.556731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce1f88-022e-4484-804f-32d113a5ca37 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:14.577751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 842/1668] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:14.577751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce1f88-022e-4484-804f-32d113a5ca37 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:14.586750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce1f88-022e-4484-804f-32d113a5ca37 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:14.592826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724b5d8-7cef-484e-8b60-4854e519827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:14.593730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b5d8-7cef-484e-8b60-4854e519827e admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:14.594287 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b5d8-7cef-484e-8b60-4854e519827e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:14.594972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b5d8-7cef-484e-8b60-4854e519827e admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:14.595948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724b5d8-7cef-484e-8b60-4854e519827e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:14.598471 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724b5d8-7cef-484e-8b60-4854e519827e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:14.632397 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-510fdf23-20f5-4f8e-9237-89bb00265e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b8d14b56094551b2c39f1cf6c20d14', 'request_id': 'req-510fdf23-20f5-4f8e-9237-89bb00265e47'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.688383 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 843/1669] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:14 2021] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:14.693776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724b5d8-7cef-484e-8b60-4854e519827e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:14.703555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-510fdf23-20f5-4f8e-9237-89bb00265e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b8d14b56094551b2c39f1cf6c20d14', 'request_id': 'req-510fdf23-20f5-4f8e-9237-89bb00265e47'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.721773 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-510fdf23-20f5-4f8e-9237-89bb00265e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b8d14b56094551b2c39f1cf6c20d14', 'request_id': 'req-510fdf23-20f5-4f8e-9237-89bb00265e47'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.737205 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-510fdf23-20f5-4f8e-9237-89bb00265e47 admin admin] The token cache is being invalidate because project 94b8d14b56094551b2c39f1cf6c20d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:14.737780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-510fdf23-20f5-4f8e-9237-89bb00265e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.738782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-510fdf23-20f5-4f8e-9237-89bb00265e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:14.741263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 827/1670] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:14 2021] DELETE /identity/v3/projects/94b8d14b56094551b2c39f1cf6c20d14 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:14.747261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a540a16-e21f-4799-8ca0-e90f3dbfcd31 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:14.752314 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a540a16-e21f-4799-8ca0-e90f3dbfcd31 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:14.752314 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a540a16-e21f-4799-8ca0-e90f3dbfcd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:14.794154 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-1a540a16-e21f-4799-8ca0-e90f3dbfcd31 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:14.798106 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1a540a16-e21f-4799-8ca0-e90f3dbfcd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:14.847616 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724b5d8-7cef-484e-8b60-4854e519827e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:14.858220 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6361de-6439-436b-ac5a-652f7af1b001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:14.859026 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6361de-6439-436b-ac5a-652f7af1b001 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:14.859309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6361de-6439-436b-ac5a-652f7af1b001 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:14.859587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6361de-6439-436b-ac5a-652f7af1b001 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:14.860280 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6361de-6439-436b-ac5a-652f7af1b001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:14.862471 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6361de-6439-436b-ac5a-652f7af1b001 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:14.910037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 828/1671] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:14.913827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eadaad-957d-449a-8e8f-cfcd87fba6fe None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:14.914705 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eadaad-957d-449a-8e8f-cfcd87fba6fe None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:14.915258 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eadaad-957d-449a-8e8f-cfcd87fba6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:14.939496 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-d0eadaad-957d-449a-8e8f-cfcd87fba6fe None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:14.940791 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d0eadaad-957d-449a-8e8f-cfcd87fba6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:14.955304 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 829/1672] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:14.957981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eadaad-957d-449a-8e8f-cfcd87fba6fe None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:14.967543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eadaad-957d-449a-8e8f-cfcd87fba6fe None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:14.972507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1a6ba-1764-4738-84cb-31413d56b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:14.973247 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1a6ba-1764-4738-84cb-31413d56b852 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:14.973599 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1a6ba-1764-4738-84cb-31413d56b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:14.973994 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1a6ba-1764-4738-84cb-31413d56b852 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:14.974793 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1a6ba-1764-4738-84cb-31413d56b852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:36:14.975162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1a6ba-1764-4738-84cb-31413d56b852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:14.977290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1a6ba-1764-4738-84cb-31413d56b852 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:14.993710 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 830/1673] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:36:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:36:14.997651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1a6ba-1764-4738-84cb-31413d56b852 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:14.999192 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 844/1674] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:14 2021] POST /identity/v3/users => generated 283 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:36:15.000502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6361de-6439-436b-ac5a-652f7af1b001 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:15.003042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3e6361de-6439-436b-ac5a-652f7af1b001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:15.013401 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1a6ba-1764-4738-84cb-31413d56b852 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:15.019784 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ca78d-6622-4516-8086-3969263ed2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:15.020777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ca78d-6622-4516-8086-3969263ed2bf admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:15.020777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ca78d-6622-4516-8086-3969263ed2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:15.021050 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ca78d-6622-4516-8086-3969263ed2bf admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:15.021805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ca78d-6622-4516-8086-3969263ed2bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:15.023062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6361de-6439-436b-ac5a-652f7af1b001 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:15.024364 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ca78d-6622-4516-8086-3969263ed2bf admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:15.030775 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fa05b-0e8b-482b-b22b-b344300cd95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:15.032319 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fa05b-0e8b-482b-b22b-b344300cd95d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:15.032854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fa05b-0e8b-482b-b22b-b344300cd95d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:15.033341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fa05b-0e8b-482b-b22b-b344300cd95d admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:15.035227 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fa05b-0e8b-482b-b22b-b344300cd95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:15.038527 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fa05b-0e8b-482b-b22b-b344300cd95d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:15.056016 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 845/1675] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:14 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:15.057287 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fa05b-0e8b-482b-b22b-b344300cd95d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:15.067631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fa05b-0e8b-482b-b22b-b344300cd95d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:15.073231 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5eebb-15a2-4ee5-836b-3cc684945ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:15.077600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5eebb-15a2-4ee5-836b-3cc684945ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:15.077600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5eebb-15a2-4ee5-836b-3cc684945ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:15.077600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5eebb-15a2-4ee5-836b-3cc684945ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:15.077600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5eebb-15a2-4ee5-836b-3cc684945ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:15.077600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5eebb-15a2-4ee5-836b-3cc684945ee7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:15.105087 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 846/1676] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:15 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:15.107473 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5eebb-15a2-4ee5-836b-3cc684945ee7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:15.122106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5eebb-15a2-4ee5-836b-3cc684945ee7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:15.129420 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4ad81-def4-410b-9627-48f93870c664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:15.130318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4ad81-def4-410b-9627-48f93870c664 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:15.130625 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4ad81-def4-410b-9627-48f93870c664 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:15.130907 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4ad81-def4-410b-9627-48f93870c664 admin admin] PATH_INFO: `/v3/projects/3229bd50909b44cf8c935231048bde53/users/63a507a571c745dea32d435f97a7b94c/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:15.152423 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4ad81-def4-410b-9627-48f93870c664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3229bd50909b44cf8c935231048bde53, user_id=63a507a571c745dea32d435f97a7b94c, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:15.156560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4ad81-def4-410b-9627-48f93870c664 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:15.173628 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 831/1677] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:14 2021] POST /identity/v3/projects => generated 369 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:15.174573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ca78d-6622-4516-8086-3969263ed2bf admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:15.258830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 847/1678] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:15 2021] PUT /identity/v3/projects/3229bd50909b44cf8c935231048bde53/users/63a507a571c745dea32d435f97a7b94c/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:15.269239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e56124-2342-44c5-83c9-26f066ab50c8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:15.269526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e56124-2342-44c5-83c9-26f066ab50c8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:15.269808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e56124-2342-44c5-83c9-26f066ab50c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:15.279016 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ca78d-6622-4516-8086-3969263ed2bf admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:15.309004 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-08e56124-2342-44c5-83c9-26f066ab50c8 None None] MFA Rules not processed for user `63a507a571c745dea32d435f97a7b94c`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:15.310466 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-08e56124-2342-44c5-83c9-26f066ab50c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:15.446289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ac524-8c85-4092-81de-e3d931c02c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:15.446986 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ac524-8c85-4092-81de-e3d931c02c45 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:15.447273 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ac524-8c85-4092-81de-e3d931c02c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:15.447555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ac524-8c85-4092-81de-e3d931c02c45 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:15.456350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ac524-8c85-4092-81de-e3d931c02c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:15.459285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 848/1679] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:15 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:15.465052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ac524-8c85-4092-81de-e3d931c02c45 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:15.468428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e56124-2342-44c5-83c9-26f066ab50c8 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:15.472417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-08e56124-2342-44c5-83c9-26f066ab50c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:15.554662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e56124-2342-44c5-83c9-26f066ab50c8 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:15.564413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a3287-0fa3-4f34-9ef5-59eaf02751c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:15.564413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a3287-0fa3-4f34-9ef5-59eaf02751c1 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:15.564413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a3287-0fa3-4f34-9ef5-59eaf02751c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:15.564413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a3287-0fa3-4f34-9ef5-59eaf02751c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:15.574832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a3287-0fa3-4f34-9ef5-59eaf02751c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:15.576981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a3287-0fa3-4f34-9ef5-59eaf02751c1 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:15.593706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 832/1680] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:15 2021] POST /identity/v3/users => generated 285 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:15.597610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ac524-8c85-4092-81de-e3d931c02c45 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:15.609513 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 849/1681] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:15 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:15.614892 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ac524-8c85-4092-81de-e3d931c02c45 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:15.622914 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78297e5f-8383-47ba-9d0b-622c9353607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:15.624181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78297e5f-8383-47ba-9d0b-622c9353607d admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:15.624665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78297e5f-8383-47ba-9d0b-622c9353607d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:15.625085 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78297e5f-8383-47ba-9d0b-622c9353607d admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:15.626169 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78297e5f-8383-47ba-9d0b-622c9353607d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:15.628292 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78297e5f-8383-47ba-9d0b-622c9353607d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:15.642944 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 833/1682] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:15 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:36:15.646617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a3287-0fa3-4f34-9ef5-59eaf02751c1 service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:15.662813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a3287-0fa3-4f34-9ef5-59eaf02751c1 service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:15.675851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bf18b-79a3-4465-ad39-f4111cdab690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:15.676763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bf18b-79a3-4465-ad39-f4111cdab690 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:15.677205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bf18b-79a3-4465-ad39-f4111cdab690 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:15.677641 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bf18b-79a3-4465-ad39-f4111cdab690 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:15.680720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bf18b-79a3-4465-ad39-f4111cdab690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:15.684948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bf18b-79a3-4465-ad39-f4111cdab690 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:15.719644 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 850/1683] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:15 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:36:15.725174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78297e5f-8383-47ba-9d0b-622c9353607d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:15.762095 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78297e5f-8383-47ba-9d0b-622c9353607d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:15.783374 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e901a7-9c87-4353-b13f-485eb2d11c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:15.788345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e901a7-9c87-4353-b13f-485eb2d11c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:15.792383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e901a7-9c87-4353-b13f-485eb2d11c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:15.793199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e901a7-9c87-4353-b13f-485eb2d11c0e admin admin] PATH_INFO: `/v3/projects/5aeeac2df7234a9fab3273922eaff6b2/users/1f1e808c5ab749329f43ac5bb16ad167/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:15.817981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bf18b-79a3-4465-ad39-f4111cdab690 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:15.821153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-252bf18b-79a3-4465-ad39-f4111cdab690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:15.835091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e901a7-9c87-4353-b13f-485eb2d11c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aeeac2df7234a9fab3273922eaff6b2, user_id=1f1e808c5ab749329f43ac5bb16ad167, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:15.838685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e901a7-9c87-4353-b13f-485eb2d11c0e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:15.853334 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bf18b-79a3-4465-ad39-f4111cdab690 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:15.865312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:15.865312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:15.865613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:15.865613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] PATH_INFO: `/v3/projects/ca5a7609b4544804b405e3345280026c` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:15.868008 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca5a7609b4544804b405e3345280026c)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:15.872687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:15.925726 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 834/1684] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:15 2021] PUT /identity/v3/projects/5aeeac2df7234a9fab3273922eaff6b2/users/1f1e808c5ab749329f43ac5bb16ad167/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:15.927809 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e87423-b6cf-41c9-b754-20f57afc4cfd None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:15.928555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e87423-b6cf-41c9-b754-20f57afc4cfd None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:15.928830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e87423-b6cf-41c9-b754-20f57afc4cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:15.949541 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-07e87423-b6cf-41c9-b754-20f57afc4cfd None None] MFA Rules not processed for user `c60cd9a36fad47d98458b8c0e28f3ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:15.950903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-07e87423-b6cf-41c9-b754-20f57afc4cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:15.983952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca5a7609b4544804b405e3345280026c', 'request_id': 'req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:16.028889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 835/1685] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:15 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:16.030870 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9466e-01f3-4f25-b42d-635d1a7389a1 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:16.031303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9466e-01f3-4f25-b42d-635d1a7389a1 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:16.031766 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9466e-01f3-4f25-b42d-635d1a7389a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:16.057401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca5a7609b4544804b405e3345280026c', 'request_id': 'req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:16.064672 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f1d9466e-01f3-4f25-b42d-635d1a7389a1 None None] MFA Rules not processed for user `1f1e808c5ab749329f43ac5bb16ad167`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:16.065612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca5a7609b4544804b405e3345280026c', 'request_id': 'req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:16.066330 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f1d9466e-01f3-4f25-b42d-635d1a7389a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:16.101231 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] The token cache is being invalidate because project ca5a7609b4544804b405e3345280026c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:16.102863 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:16.103748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:16.108474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 851/1686] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:15 2021] DELETE /identity/v3/projects/ca5a7609b4544804b405e3345280026c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:16.109579 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:16.111413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:16.182232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 836/1687] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:16 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:16.186782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9466e-01f3-4f25-b42d-635d1a7389a1 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:16.188192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f1d9466e-01f3-4f25-b42d-635d1a7389a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:16.208623 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb8ec7-93cc-4586-9f2f-10f2a2891ee6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:16.217150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:16.218126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:16.218406 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:16.218679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] PATH_INFO: `/v3/users/4fb51a97c70d4d2384c3e229fc99af45` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:16.220009 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb51a97c70d4d2384c3e229fc99af45)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:16.222338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:16.276895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9466e-01f3-4f25-b42d-635d1a7389a1 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:16.281889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09366375-5fae-44f6-9eb3-399a3a40c933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:16.282498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09366375-5fae-44f6-9eb3-399a3a40c933 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:16.282672 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09366375-5fae-44f6-9eb3-399a3a40c933 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:16.283478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09366375-5fae-44f6-9eb3-399a3a40c933 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:16.284192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09366375-5fae-44f6-9eb3-399a3a40c933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:16.287053 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09366375-5fae-44f6-9eb3-399a3a40c933 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:16.388091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 837/1688] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:16 2021] POST /identity/v3/projects => generated 369 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:36:16.390038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09366375-5fae-44f6-9eb3-399a3a40c933 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:16.451380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb51a97c70d4d2384c3e229fc99af45'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:16.452237 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb51a97c70d4d2384c3e229fc99af45'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:16.453194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb51a97c70d4d2384c3e229fc99af45'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:16.477584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09366375-5fae-44f6-9eb3-399a3a40c933 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:16.481172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cd8f4-8470-4b38-a747-81c413ce1294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:16.481876 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cd8f4-8470-4b38-a747-81c413ce1294 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:16.482185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cd8f4-8470-4b38-a747-81c413ce1294 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:16.482457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cd8f4-8470-4b38-a747-81c413ce1294 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:16.483149 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cd8f4-8470-4b38-a747-81c413ce1294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:16.485217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cd8f4-8470-4b38-a747-81c413ce1294 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:16.538320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb51a97c70d4d2384c3e229fc99af45'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:16.572819 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb51a97c70d4d2384c3e229fc99af45'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:16.589798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 852/1689] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:16 2021] DELETE /identity/v3/users/4fb51a97c70d4d2384c3e229fc99af45 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:16.613310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 838/1690] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:16 2021] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:16.620029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:16.624005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:16.699061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd87dc-19c8-442e-b61f-e66384cab7b8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:16.706423 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5384ffb-73b2-4d91-99c1-805ced994234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:16.707349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5384ffb-73b2-4d91-99c1-805ced994234 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:16.707959 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5384ffb-73b2-4d91-99c1-805ced994234 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:16.708438 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5384ffb-73b2-4d91-99c1-805ced994234 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:16.709400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5384ffb-73b2-4d91-99c1-805ced994234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:16.712576 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5384ffb-73b2-4d91-99c1-805ced994234 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:16.726202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 853/1691] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:16 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:16.730610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cd8f4-8470-4b38-a747-81c413ce1294 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:16.741239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cd8f4-8470-4b38-a747-81c413ce1294 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:16.746812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7609623-7edb-4447-ab33-296e2bdd6f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:16.748707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7609623-7edb-4447-ab33-296e2bdd6f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:16.748707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7609623-7edb-4447-ab33-296e2bdd6f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:16.748707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7609623-7edb-4447-ab33-296e2bdd6f36 admin admin] PATH_INFO: `/v3/projects/546ffbc6c9284a8e81040a81fa98ae58/users/942d64c3208049c8872d269d55a3ca77/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:16.766303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7609623-7edb-4447-ab33-296e2bdd6f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=546ffbc6c9284a8e81040a81fa98ae58, user_id=942d64c3208049c8872d269d55a3ca77, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:16.769381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7609623-7edb-4447-ab33-296e2bdd6f36 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:16.850744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 839/1692] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:16 2021] PUT /identity/v3/projects/546ffbc6c9284a8e81040a81fa98ae58/users/942d64c3208049c8872d269d55a3ca77/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:16.852702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5384ffb-73b2-4d91-99c1-805ced994234 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:16.864769 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5384ffb-73b2-4d91-99c1-805ced994234 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:16.948161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557ade8-88aa-490d-aa6b-db266c698b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:16.949084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ade8-88aa-490d-aa6b-db266c698b76 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:16.949568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ade8-88aa-490d-aa6b-db266c698b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:16.950119 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ade8-88aa-490d-aa6b-db266c698b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:16.951079 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ade8-88aa-490d-aa6b-db266c698b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:16.952913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ade8-88aa-490d-aa6b-db266c698b76 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:16.977088 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 854/1693] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:16 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:16.984125 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7609623-7edb-4447-ab33-296e2bdd6f36 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:16.996657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7609623-7edb-4447-ab33-296e2bdd6f36 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:17.002032 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9d289-a8dd-4326-bc7e-dd325f273fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:17.003224 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9d289-a8dd-4326-bc7e-dd325f273fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:17.003658 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9d289-a8dd-4326-bc7e-dd325f273fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:17.003961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9d289-a8dd-4326-bc7e-dd325f273fa8 admin admin] PATH_INFO: `/v3/projects/546ffbc6c9284a8e81040a81fa98ae58/users/942d64c3208049c8872d269d55a3ca77/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:17.006101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9d289-a8dd-4326-bc7e-dd325f273fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=546ffbc6c9284a8e81040a81fa98ae58, user_id=942d64c3208049c8872d269d55a3ca77, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:17.009440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9d289-a8dd-4326-bc7e-dd325f273fa8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:17.022145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 840/1694] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:16 2021] PUT /identity/v3/projects/546ffbc6c9284a8e81040a81fa98ae58/users/942d64c3208049c8872d269d55a3ca77/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:17.031825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10296db-bd5b-45c1-b814-8a025d7950e1 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:17.032120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10296db-bd5b-45c1-b814-8a025d7950e1 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:17.032402 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10296db-bd5b-45c1-b814-8a025d7950e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:17.063093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c10296db-bd5b-45c1-b814-8a025d7950e1 None None] MFA Rules not processed for user `942d64c3208049c8872d269d55a3ca77`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:17.065115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c10296db-bd5b-45c1-b814-8a025d7950e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:17.138315 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 855/1695] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:17 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:17.148365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9d289-a8dd-4326-bc7e-dd325f273fa8 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:17.150149 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f1d9d289-a8dd-4326-bc7e-dd325f273fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:17.220082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9d289-a8dd-4326-bc7e-dd325f273fa8 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:17.224070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867212-7998-410c-8925-4f2acccb4658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:17.224908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867212-7998-410c-8925-4f2acccb4658 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:17.225079 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867212-7998-410c-8925-4f2acccb4658 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:17.225358 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867212-7998-410c-8925-4f2acccb4658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:17.237082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867212-7998-410c-8925-4f2acccb4658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:17.238627 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867212-7998-410c-8925-4f2acccb4658 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:17.250469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 841/1696] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:17 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:17.614071 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10296db-bd5b-45c1-b814-8a025d7950e1 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:17.615810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c10296db-bd5b-45c1-b814-8a025d7950e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:17.749672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10296db-bd5b-45c1-b814-8a025d7950e1 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:17.763859 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba5fca-dece-4a9e-a63a-fe4b35df9433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:17.765548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba5fca-dece-4a9e-a63a-fe4b35df9433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:17.768570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba5fca-dece-4a9e-a63a-fe4b35df9433 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:17.768877 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba5fca-dece-4a9e-a63a-fe4b35df9433 admin admin] PATH_INFO: `/v3/projects/99c17fd84c344115a2acbc1be4c0a165` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:17.773767 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba5fca-dece-4a9e-a63a-fe4b35df9433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c17fd84c344115a2acbc1be4c0a165)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:17.776428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba5fca-dece-4a9e-a63a-fe4b35df9433 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:17.978603 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-25ba5fca-dece-4a9e-a63a-fe4b35df9433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c17fd84c344115a2acbc1be4c0a165', 'request_id': 'req-25ba5fca-dece-4a9e-a63a-fe4b35df9433'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:18.158390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-25ba5fca-dece-4a9e-a63a-fe4b35df9433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c17fd84c344115a2acbc1be4c0a165', 'request_id': 'req-25ba5fca-dece-4a9e-a63a-fe4b35df9433'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:18.168985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-25ba5fca-dece-4a9e-a63a-fe4b35df9433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c17fd84c344115a2acbc1be4c0a165', 'request_id': 'req-25ba5fca-dece-4a9e-a63a-fe4b35df9433'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:18.185436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-25ba5fca-dece-4a9e-a63a-fe4b35df9433 admin admin] The token cache is being invalidate because project 99c17fd84c344115a2acbc1be4c0a165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:18.186507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-25ba5fca-dece-4a9e-a63a-fe4b35df9433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:18.187164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-25ba5fca-dece-4a9e-a63a-fe4b35df9433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:18.188808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 856/1697] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:17 2021] DELETE /identity/v3/projects/99c17fd84c344115a2acbc1be4c0a165 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:18.194891 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0c96e-996b-4e8d-9a1e-43ad36f4c3a6 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:18.196138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0c96e-996b-4e8d-9a1e-43ad36f4c3a6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:18.196138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0c96e-996b-4e8d-9a1e-43ad36f4c3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:18.214657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-adc0c96e-996b-4e8d-9a1e-43ad36f4c3a6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:18.216160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-adc0c96e-996b-4e8d-9a1e-43ad36f4c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:18.285773 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 842/1698] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:18.294132 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26cac1-376b-4bbe-8505-b3c65d5da8da None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:18.294427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26cac1-376b-4bbe-8505-b3c65d5da8da None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:18.294716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26cac1-376b-4bbe-8505-b3c65d5da8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:18.323313 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-ec26cac1-376b-4bbe-8505-b3c65d5da8da None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:18.324741 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ec26cac1-376b-4bbe-8505-b3c65d5da8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:18.337225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 857/1699] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:18.344511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0c96e-996b-4e8d-9a1e-43ad36f4c3a6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:18.361949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0c96e-996b-4e8d-9a1e-43ad36f4c3a6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:18.367533 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33daf72-59c4-4a07-80d1-37ae967ab6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:18.369036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33daf72-59c4-4a07-80d1-37ae967ab6dd admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:18.369036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33daf72-59c4-4a07-80d1-37ae967ab6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:18.369036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33daf72-59c4-4a07-80d1-37ae967ab6dd admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:18.369688 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33daf72-59c4-4a07-80d1-37ae967ab6dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:36:18.370036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33daf72-59c4-4a07-80d1-37ae967ab6dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:18.371656 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33daf72-59c4-4a07-80d1-37ae967ab6dd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:18.387714 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 843/1700] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:36:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:36:18.392828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26cac1-376b-4bbe-8505-b3c65d5da8da None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:18.402440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26cac1-376b-4bbe-8505-b3c65d5da8da None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:18.407465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdba6a-378a-43a8-9915-77f9f3d87f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:18.408130 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdba6a-378a-43a8-9915-77f9f3d87f93 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:18.408413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdba6a-378a-43a8-9915-77f9f3d87f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:18.408687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdba6a-378a-43a8-9915-77f9f3d87f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:18.409381 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdba6a-378a-43a8-9915-77f9f3d87f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:18.412278 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdba6a-378a-43a8-9915-77f9f3d87f93 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:18.506451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 858/1701] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:18 2021] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:18.510946 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33daf72-59c4-4a07-80d1-37ae967ab6dd admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:18.523829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33daf72-59c4-4a07-80d1-37ae967ab6dd admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:18.610934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd560d-48e6-495d-8a44-e433dcbb1960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:18.611635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd560d-48e6-495d-8a44-e433dcbb1960 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:18.611924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd560d-48e6-495d-8a44-e433dcbb1960 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:18.612204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd560d-48e6-495d-8a44-e433dcbb1960 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:18.612897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd560d-48e6-495d-8a44-e433dcbb1960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:18.615071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd560d-48e6-495d-8a44-e433dcbb1960 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:18.742957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 844/1702] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:18 2021] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:18.747167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdba6a-378a-43a8-9915-77f9f3d87f93 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:18.758955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdba6a-378a-43a8-9915-77f9f3d87f93 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:18.763656 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6842c5-6545-4d1f-a19f-2eee312cdc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:18.764323 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6842c5-6545-4d1f-a19f-2eee312cdc8b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:18.764599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6842c5-6545-4d1f-a19f-2eee312cdc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:18.764872 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6842c5-6545-4d1f-a19f-2eee312cdc8b admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:18.765648 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6842c5-6545-4d1f-a19f-2eee312cdc8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:18.769705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6842c5-6545-4d1f-a19f-2eee312cdc8b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:18.779064 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 859/1703] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:18 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:18.783159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd560d-48e6-495d-8a44-e433dcbb1960 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:18.793308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd560d-48e6-495d-8a44-e433dcbb1960 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:18.800701 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d1927-6d56-428f-b6a7-76a53008e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:18.803453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d1927-6d56-428f-b6a7-76a53008e6ac admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:18.803733 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d1927-6d56-428f-b6a7-76a53008e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:18.803994 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d1927-6d56-428f-b6a7-76a53008e6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:18.804799 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d1927-6d56-428f-b6a7-76a53008e6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:18.806514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d1927-6d56-428f-b6a7-76a53008e6ac admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:18.818315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 845/1704] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:18 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:36:18.823700 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6842c5-6545-4d1f-a19f-2eee312cdc8b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:18.836958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6842c5-6545-4d1f-a19f-2eee312cdc8b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:18.841835 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e73601-2957-40b0-89e8-0f39f4b90140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:18.842785 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e73601-2957-40b0-89e8-0f39f4b90140 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:18.843066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e73601-2957-40b0-89e8-0f39f4b90140 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:18.843336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e73601-2957-40b0-89e8-0f39f4b90140 admin admin] PATH_INFO: `/v3/projects/905e3ce4475b4d54a3b4ed62f3c31bc9/users/2a7015c0b9ac43db99f2f126f304e065/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:18.858645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e73601-2957-40b0-89e8-0f39f4b90140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=905e3ce4475b4d54a3b4ed62f3c31bc9, user_id=2a7015c0b9ac43db99f2f126f304e065, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:18.861261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e73601-2957-40b0-89e8-0f39f4b90140 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:18.908849 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec467-73a9-4139-83f6-009daf09a279 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:18.909135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec467-73a9-4139-83f6-009daf09a279 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:18.909973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec467-73a9-4139-83f6-009daf09a279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:18.927168 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-5a4ec467-73a9-4139-83f6-009daf09a279 None None] MFA Rules not processed for user `304ebf23ad9c47eeba8baec42e096a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:18.928357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5a4ec467-73a9-4139-83f6-009daf09a279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:18.991430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 846/1705] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:18 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:19.002194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 860/1706] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:18 2021] PUT /identity/v3/projects/905e3ce4475b4d54a3b4ed62f3c31bc9/users/2a7015c0b9ac43db99f2f126f304e065/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:36:19.064185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76534c-def5-46dc-9fe5-39d3a2c1fabc None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:19.064482 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76534c-def5-46dc-9fe5-39d3a2c1fabc None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:19.064767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76534c-def5-46dc-9fe5-39d3a2c1fabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:19.105338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-de76534c-def5-46dc-9fe5-39d3a2c1fabc None None] MFA Rules not processed for user `2a7015c0b9ac43db99f2f126f304e065`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:19.106688 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-de76534c-def5-46dc-9fe5-39d3a2c1fabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:19.178555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 847/1707] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:19 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:19.183401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e73601-2957-40b0-89e8-0f39f4b90140 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:19.252574 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e73601-2957-40b0-89e8-0f39f4b90140 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:19.258769 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a566bb7-5b2f-43ff-8494-a90bdbf65c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:19.260046 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566bb7-5b2f-43ff-8494-a90bdbf65c55 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:19.260390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566bb7-5b2f-43ff-8494-a90bdbf65c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:19.260729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566bb7-5b2f-43ff-8494-a90bdbf65c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:19.262044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a566bb7-5b2f-43ff-8494-a90bdbf65c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:19.265148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a566bb7-5b2f-43ff-8494-a90bdbf65c55 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:19.368569 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 861/1708] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:19 2021] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:36:19.372753 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76534c-def5-46dc-9fe5-39d3a2c1fabc None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:19.384074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76534c-def5-46dc-9fe5-39d3a2c1fabc None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:19.480214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ee273-9a87-43e8-8263-f6a3551c3643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:19.481138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ee273-9a87-43e8-8263-f6a3551c3643 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:19.481499 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ee273-9a87-43e8-8263-f6a3551c3643 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:19.482302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ee273-9a87-43e8-8263-f6a3551c3643 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:19.483095 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ee273-9a87-43e8-8263-f6a3551c3643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:19.485916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ee273-9a87-43e8-8263-f6a3551c3643 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:19.580326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f3b5b-4c52-4e99-9ee8-6407be1ede1a None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:19.580613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f3b5b-4c52-4e99-9ee8-6407be1ede1a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:19.582702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f3b5b-4c52-4e99-9ee8-6407be1ede1a None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:19.582702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 862/1709] 10.222.0.16 () {54 vars in 921 bytes} [Sun Aug 29 14:36:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:36:19.595312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e847216-e301-41d4-8e9f-119bc329f078 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:19.595589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e847216-e301-41d4-8e9f-119bc329f078 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:19.595871 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e847216-e301-41d4-8e9f-119bc329f078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:19.619901 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-7e847216-e301-41d4-8e9f-119bc329f078 None None] MFA Rules not processed for user `d8c0afa8f09f4923b9c8ab2696156129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:19.621449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7e847216-e301-41d4-8e9f-119bc329f078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:19.622341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 848/1710] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:19 2021] POST /identity/v3/users => generated 295 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:19.628705 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ee273-9a87-43e8-8263-f6a3551c3643 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:19.650579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ee273-9a87-43e8-8263-f6a3551c3643 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:19.668614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc285f25-2312-4e0a-b72c-345e371c0039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:19.669314 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc285f25-2312-4e0a-b72c-345e371c0039 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:19.669602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc285f25-2312-4e0a-b72c-345e371c0039 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:19.670223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc285f25-2312-4e0a-b72c-345e371c0039 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:19.674965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc285f25-2312-4e0a-b72c-345e371c0039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:19.676760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc285f25-2312-4e0a-b72c-345e371c0039 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:19.703350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 849/1711] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:19 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:19.707222 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc285f25-2312-4e0a-b72c-345e371c0039 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:19.732145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc285f25-2312-4e0a-b72c-345e371c0039 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:19.744061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696bc05-2ae1-4f51-80e2-0c42088560c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:19.744968 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696bc05-2ae1-4f51-80e2-0c42088560c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:19.745251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696bc05-2ae1-4f51-80e2-0c42088560c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:19.745525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696bc05-2ae1-4f51-80e2-0c42088560c1 admin admin] PATH_INFO: `/v3/projects/4e4dfd7e01614873a106ca2ea4683361/users/891afc29e03345ae85f399706c1f51de/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:19.751438 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 863/1712] 10.222.0.16 () {58 vars in 1019 bytes} [Sun Aug 29 14:36:19 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:19.780774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696bc05-2ae1-4f51-80e2-0c42088560c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4dfd7e01614873a106ca2ea4683361, user_id=891afc29e03345ae85f399706c1f51de, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:19.784340 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696bc05-2ae1-4f51-80e2-0c42088560c1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:19.859289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 850/1713] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:19 2021] PUT /identity/v3/projects/4e4dfd7e01614873a106ca2ea4683361/users/891afc29e03345ae85f399706c1f51de/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:36:19.863687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e847216-e301-41d4-8e9f-119bc329f078 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:19.876045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e847216-e301-41d4-8e9f-119bc329f078 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:19.913118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696bc05-2ae1-4f51-80e2-0c42088560c1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:19.916013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7696bc05-2ae1-4f51-80e2-0c42088560c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:20.003315 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c4be1-b384-4b3e-b944-a3021a31f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:20.004233 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c4be1-b384-4b3e-b944-a3021a31f8fa admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:20.004869 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c4be1-b384-4b3e-b944-a3021a31f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:20.005284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c4be1-b384-4b3e-b944-a3021a31f8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:20.006552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c4be1-b384-4b3e-b944-a3021a31f8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:20.009416 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c4be1-b384-4b3e-b944-a3021a31f8fa admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:20.039501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 864/1714] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:19 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:36:20.044448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c4be1-b384-4b3e-b944-a3021a31f8fa admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:20.070124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c4be1-b384-4b3e-b944-a3021a31f8fa admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:20.076351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a68b9-c988-4206-866b-bce97fe9363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:20.077578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a68b9-c988-4206-866b-bce97fe9363b admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:20.079342 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a68b9-c988-4206-866b-bce97fe9363b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:20.079342 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a68b9-c988-4206-866b-bce97fe9363b admin admin] PATH_INFO: `/v3/projects/4e4dfd7e01614873a106ca2ea4683361/users/891afc29e03345ae85f399706c1f51de/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:20.081530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a68b9-c988-4206-866b-bce97fe9363b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4dfd7e01614873a106ca2ea4683361, user_id=891afc29e03345ae85f399706c1f51de, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:20.084911 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a68b9-c988-4206-866b-bce97fe9363b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:20.100452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 865/1715] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:20 2021] PUT /identity/v3/projects/4e4dfd7e01614873a106ca2ea4683361/users/891afc29e03345ae85f399706c1f51de/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:20.113395 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e4c8a-464f-4364-aecc-1590ed51d463 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:20.113851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e4c8a-464f-4364-aecc-1590ed51d463 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:20.114353 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e4c8a-464f-4364-aecc-1590ed51d463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:20.144446 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696bc05-2ae1-4f51-80e2-0c42088560c1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:20.170658 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-e89e4c8a-464f-4364-aecc-1590ed51d463 None None] MFA Rules not processed for user `891afc29e03345ae85f399706c1f51de`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:20.173443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e89e4c8a-464f-4364-aecc-1590ed51d463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:20.281649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 866/1716] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:20 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:20.284402 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be5029-2762-4be7-b2e4-c03d03be8b24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:20.285164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be5029-2762-4be7-b2e4-c03d03be8b24 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:20.285363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be5029-2762-4be7-b2e4-c03d03be8b24 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:20.285673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be5029-2762-4be7-b2e4-c03d03be8b24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:20.296538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e4c8a-464f-4364-aecc-1590ed51d463 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:20.298023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e89e4c8a-464f-4364-aecc-1590ed51d463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:20.310288 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be5029-2762-4be7-b2e4-c03d03be8b24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:20.312169 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be5029-2762-4be7-b2e4-c03d03be8b24 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:20.325336 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 851/1717] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:19 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:20.426977 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e4c8a-464f-4364-aecc-1590ed51d463 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:20.431846 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f64b03-4b68-43bc-821b-6c18e491423f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:20.432260 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f64b03-4b68-43bc-821b-6c18e491423f service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:20.432542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f64b03-4b68-43bc-821b-6c18e491423f service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:20.432820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f64b03-4b68-43bc-821b-6c18e491423f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:20.535209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f64b03-4b68-43bc-821b-6c18e491423f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:20.539507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f64b03-4b68-43bc-821b-6c18e491423f service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:20.549622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 867/1718] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:20 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:36:21.865148 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be5029-2762-4be7-b2e4-c03d03be8b24 service nova] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:21.867871 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-15be5029-2762-4be7-b2e4-c03d03be8b24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:21.939000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be5029-2762-4be7-b2e4-c03d03be8b24 service nova] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:21.943801 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:21.945084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:21.945465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:21.945809 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] PATH_INFO: `/v3/users/1f1e808c5ab749329f43ac5bb16ad167` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:21.947333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1e808c5ab749329f43ac5bb16ad167)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:21.949584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:22.354254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1e808c5ab749329f43ac5bb16ad167'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:22.354941 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1e808c5ab749329f43ac5bb16ad167'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:22.362526 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1e808c5ab749329f43ac5bb16ad167'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:22.434585 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1e808c5ab749329f43ac5bb16ad167'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:22.448761 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1e808c5ab749329f43ac5bb16ad167'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:22.456048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 852/1719] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:21 2021] DELETE /identity/v3/users/1f1e808c5ab749329f43ac5bb16ad167 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:22.461706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915732e-f6d6-453e-ab19-0b8796946155 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:22.461706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915732e-f6d6-453e-ab19-0b8796946155 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:22.462352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915732e-f6d6-453e-ab19-0b8796946155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:22.481074 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3915732e-f6d6-453e-ab19-0b8796946155 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:22.482401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3915732e-f6d6-453e-ab19-0b8796946155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:22.621315 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 868/1720] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:22.632834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:22.634415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:22.734413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792db8dc-f3ac-427b-95e9-b189a983464e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:22.743101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e8d0e-110d-4df4-8334-c1f4d3998d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:22.743772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e8d0e-110d-4df4-8334-c1f4d3998d3a service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:22.743997 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e8d0e-110d-4df4-8334-c1f4d3998d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:22.744266 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e8d0e-110d-4df4-8334-c1f4d3998d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:22.763493 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e8d0e-110d-4df4-8334-c1f4d3998d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:22.765599 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e8d0e-110d-4df4-8334-c1f4d3998d3a service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:22.811064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 853/1721] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:23.995628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915732e-f6d6-453e-ab19-0b8796946155 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:23.997014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3915732e-f6d6-453e-ab19-0b8796946155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:24.010494 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915732e-f6d6-453e-ab19-0b8796946155 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:24.015553 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:24.016363 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:24.016646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:24.016923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] PATH_INFO: `/v3/projects/5aeeac2df7234a9fab3273922eaff6b2` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:24.018163 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aeeac2df7234a9fab3273922eaff6b2)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:24.020205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:24.150038 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aeeac2df7234a9fab3273922eaff6b2', 'request_id': 'req-edc3c02d-2d4b-4dea-934e-4b67d161b285'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:24.220432 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aeeac2df7234a9fab3273922eaff6b2', 'request_id': 'req-edc3c02d-2d4b-4dea-934e-4b67d161b285'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:24.226724 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aeeac2df7234a9fab3273922eaff6b2', 'request_id': 'req-edc3c02d-2d4b-4dea-934e-4b67d161b285'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:24.237419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] The token cache is being invalidate because project 5aeeac2df7234a9fab3273922eaff6b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:24.237706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:24.238428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:24.239956 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 869/1722] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:23 2021] DELETE /identity/v3/projects/5aeeac2df7234a9fab3273922eaff6b2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:24.244204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e8d0e-110d-4df4-8334-c1f4d3998d3a service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:24.253559 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e8d0e-110d-4df4-8334-c1f4d3998d3a service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:24.306867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6719455-3b1a-4485-98a1-b7765bd654e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:24.307724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6719455-3b1a-4485-98a1-b7765bd654e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:24.308003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6719455-3b1a-4485-98a1-b7765bd654e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:24.308275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6719455-3b1a-4485-98a1-b7765bd654e7 admin admin] PATH_INFO: `/v3/users/942d64c3208049c8872d269d55a3ca77` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:24.309444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6719455-3b1a-4485-98a1-b7765bd654e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=942d64c3208049c8872d269d55a3ca77)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:24.311363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6719455-3b1a-4485-98a1-b7765bd654e7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:24.499341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c6719455-3b1a-4485-98a1-b7765bd654e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942d64c3208049c8872d269d55a3ca77'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:24.500723 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c6719455-3b1a-4485-98a1-b7765bd654e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942d64c3208049c8872d269d55a3ca77'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:24.508358 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c6719455-3b1a-4485-98a1-b7765bd654e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942d64c3208049c8872d269d55a3ca77'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:24.603269 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c6719455-3b1a-4485-98a1-b7765bd654e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942d64c3208049c8872d269d55a3ca77'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:24.615035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c6719455-3b1a-4485-98a1-b7765bd654e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942d64c3208049c8872d269d55a3ca77'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:24.621350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 854/1723] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:24 2021] DELETE /identity/v3/users/942d64c3208049c8872d269d55a3ca77 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:25.056905 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:25.058351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:25.071745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3c02d-2d4b-4dea-934e-4b67d161b285 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:25.132823 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:25.133831 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:25.134162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:25.134418 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8 admin admin] PATH_INFO: `/v3/projects/546ffbc6c9284a8e81040a81fa98ae58` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:25.135645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546ffbc6c9284a8e81040a81fa98ae58)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:25.137510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:25.244946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546ffbc6c9284a8e81040a81fa98ae58', 'request_id': 'req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:25.348045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546ffbc6c9284a8e81040a81fa98ae58', 'request_id': 'req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:25.354224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546ffbc6c9284a8e81040a81fa98ae58', 'request_id': 'req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:25.365140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8 admin admin] The token cache is being invalidate because project 546ffbc6c9284a8e81040a81fa98ae58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:25.365423 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:25.366104 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-acecbcbd-3dd2-4ada-a803-3fd22d29fff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:25.368174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 870/1724] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:25 2021] DELETE /identity/v3/projects/546ffbc6c9284a8e81040a81fa98ae58 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:25.374343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcba9c-aa3f-41fb-bd6b-e6eff3212f86 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:25.379975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcba9c-aa3f-41fb-bd6b-e6eff3212f86 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:25.379975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcba9c-aa3f-41fb-bd6b-e6eff3212f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:25.393689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-37fcba9c-aa3f-41fb-bd6b-e6eff3212f86 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:25.394923 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-37fcba9c-aa3f-41fb-bd6b-e6eff3212f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:25.465259 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 855/1725] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:25.473266 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a815be-ccb8-4ed6-b003-67109b9a131a None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:25.473555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a815be-ccb8-4ed6-b003-67109b9a131a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:25.473852 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a815be-ccb8-4ed6-b003-67109b9a131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:25.496361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c7a815be-ccb8-4ed6-b003-67109b9a131a None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:25.497784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c7a815be-ccb8-4ed6-b003-67109b9a131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:25.506255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 871/1726] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:25.510995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcba9c-aa3f-41fb-bd6b-e6eff3212f86 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:25.520570 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcba9c-aa3f-41fb-bd6b-e6eff3212f86 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:25.525663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3516eaf-3d23-44a2-a828-00c595b48d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:25.526342 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3516eaf-3d23-44a2-a828-00c595b48d60 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:25.526675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3516eaf-3d23-44a2-a828-00c595b48d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:25.526959 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3516eaf-3d23-44a2-a828-00c595b48d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:25.527706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3516eaf-3d23-44a2-a828-00c595b48d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:36:25.528007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3516eaf-3d23-44a2-a828-00c595b48d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:25.529620 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3516eaf-3d23-44a2-a828-00c595b48d60 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:25.541932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 856/1727] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:36:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:36:25.547061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a815be-ccb8-4ed6-b003-67109b9a131a None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:25.557248 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a815be-ccb8-4ed6-b003-67109b9a131a None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:25.561972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7126-e1c1-421b-bba2-aba639dbe4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:25.562619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7126-e1c1-421b-bba2-aba639dbe4fc admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:25.562894 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7126-e1c1-421b-bba2-aba639dbe4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:25.563168 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7126-e1c1-421b-bba2-aba639dbe4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:25.566714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b7126-e1c1-421b-bba2-aba639dbe4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:25.566714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b7126-e1c1-421b-bba2-aba639dbe4fc admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:25.651260 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 872/1728] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:25 2021] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:25.655349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3516eaf-3d23-44a2-a828-00c595b48d60 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:25.666330 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3516eaf-3d23-44a2-a828-00c595b48d60 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:25.726709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133559af-88ae-4f53-979a-b69147ccab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:25.728419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133559af-88ae-4f53-979a-b69147ccab6e admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:25.728700 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133559af-88ae-4f53-979a-b69147ccab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:25.728972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133559af-88ae-4f53-979a-b69147ccab6e admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:25.729662 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133559af-88ae-4f53-979a-b69147ccab6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:25.731640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133559af-88ae-4f53-979a-b69147ccab6e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:25.821270 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 857/1729] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:25 2021] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:36:25.832973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7126-e1c1-421b-bba2-aba639dbe4fc admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:25.843688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7126-e1c1-421b-bba2-aba639dbe4fc admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:25.852966 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01768e3-ebfc-44f4-a2b5-33efd158be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:25.853628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01768e3-ebfc-44f4-a2b5-33efd158be5d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:25.853939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01768e3-ebfc-44f4-a2b5-33efd158be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:25.854211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01768e3-ebfc-44f4-a2b5-33efd158be5d admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:25.855291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01768e3-ebfc-44f4-a2b5-33efd158be5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:25.857451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01768e3-ebfc-44f4-a2b5-33efd158be5d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:25.869831 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 873/1730] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:25 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:25.874028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133559af-88ae-4f53-979a-b69147ccab6e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:25.883703 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133559af-88ae-4f53-979a-b69147ccab6e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:25.888333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8564347-5d44-47db-9b06-1b26cdd0f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:25.888979 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8564347-5d44-47db-9b06-1b26cdd0f06f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:25.889260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8564347-5d44-47db-9b06-1b26cdd0f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:25.889534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8564347-5d44-47db-9b06-1b26cdd0f06f admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:25.890525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8564347-5d44-47db-9b06-1b26cdd0f06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:25.893215 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8564347-5d44-47db-9b06-1b26cdd0f06f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:25.903516 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 858/1731] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:25 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:36:25.907460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01768e3-ebfc-44f4-a2b5-33efd158be5d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:25.917809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01768e3-ebfc-44f4-a2b5-33efd158be5d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:25.922413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe66f15-9aca-4b4a-80d3-102a675499bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:25.923275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe66f15-9aca-4b4a-80d3-102a675499bb admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:25.923553 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe66f15-9aca-4b4a-80d3-102a675499bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:25.923825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe66f15-9aca-4b4a-80d3-102a675499bb admin admin] PATH_INFO: `/v3/projects/edf6d87ad29a40dfbc05046422d53977/users/928471014e704162920136ac0336dff3/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:25.937914 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe66f15-9aca-4b4a-80d3-102a675499bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf6d87ad29a40dfbc05046422d53977, user_id=928471014e704162920136ac0336dff3, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:25.940538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe66f15-9aca-4b4a-80d3-102a675499bb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:26.014836 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 874/1732] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:25 2021] PUT /identity/v3/projects/edf6d87ad29a40dfbc05046422d53977/users/928471014e704162920136ac0336dff3/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:26.026638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b4692-8c70-4a52-b43b-7e2b84c8a059 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:26.026928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b4692-8c70-4a52-b43b-7e2b84c8a059 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:26.027260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b4692-8c70-4a52-b43b-7e2b84c8a059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:26.053990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-723b4692-8c70-4a52-b43b-7e2b84c8a059 None None] MFA Rules not processed for user `928471014e704162920136ac0336dff3`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:26.055244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-723b4692-8c70-4a52-b43b-7e2b84c8a059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:26.123536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 859/1733] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:26 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:26.134329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe66f15-9aca-4b4a-80d3-102a675499bb admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:26.136086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-cfe66f15-9aca-4b4a-80d3-102a675499bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:26.192922 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe66f15-9aca-4b4a-80d3-102a675499bb admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:26.197650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55e6da-7173-41de-a5af-c2a581500a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:26.198377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55e6da-7173-41de-a5af-c2a581500a14 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:26.198659 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55e6da-7173-41de-a5af-c2a581500a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:26.198933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55e6da-7173-41de-a5af-c2a581500a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:26.210994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55e6da-7173-41de-a5af-c2a581500a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:26.213371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55e6da-7173-41de-a5af-c2a581500a14 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:26.228962 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 875/1734] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:26 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:27.287178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b4692-8c70-4a52-b43b-7e2b84c8a059 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:27.288676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-723b4692-8c70-4a52-b43b-7e2b84c8a059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:27.303160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b4692-8c70-4a52-b43b-7e2b84c8a059 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:27.307860 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd8c07-b778-466e-84e9-4eba4282497a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:27.308512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd8c07-b778-466e-84e9-4eba4282497a service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:27.308792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd8c07-b778-466e-84e9-4eba4282497a service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:27.309066 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd8c07-b778-466e-84e9-4eba4282497a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:27.311000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-6cdd8c07-b778-466e-84e9-4eba4282497a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:27.377347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd8c07-b778-466e-84e9-4eba4282497a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:27.378774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd8c07-b778-466e-84e9-4eba4282497a service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:27.390036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 860/1735] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:27 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:36.507805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55e6da-7173-41de-a5af-c2a581500a14 service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:36.509429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2e55e6da-7173-41de-a5af-c2a581500a14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:36.577435 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55e6da-7173-41de-a5af-c2a581500a14 service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:36.581943 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:36.582820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:36.583099 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:36.583371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] PATH_INFO: `/v3/users/63a507a571c745dea32d435f97a7b94c` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:36.584544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a507a571c745dea32d435f97a7b94c)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:36.586486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:36.759099 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a507a571c745dea32d435f97a7b94c'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:36.759755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a507a571c745dea32d435f97a7b94c'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:36.760369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a507a571c745dea32d435f97a7b94c'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:36.842884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a507a571c745dea32d435f97a7b94c'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:36.855653 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a507a571c745dea32d435f97a7b94c'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:36.868401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 876/1736] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:36 2021] DELETE /identity/v3/users/63a507a571c745dea32d435f97a7b94c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:36.873129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff156889-c78a-4104-82c4-0261e748d2e8 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:36.873638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff156889-c78a-4104-82c4-0261e748d2e8 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:36.873724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff156889-c78a-4104-82c4-0261e748d2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:36.890678 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-ff156889-c78a-4104-82c4-0261e748d2e8 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:36.891862 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ff156889-c78a-4104-82c4-0261e748d2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:36.958959 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 861/1737] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:36.968869 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:36.970283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:37.030713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4175fa6-76ac-4d57-a6cb-cad681868a01 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:37.034344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ec234-aead-4c84-8184-dff0bb6eeae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:37.034990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ec234-aead-4c84-8184-dff0bb6eeae0 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:37.035272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ec234-aead-4c84-8184-dff0bb6eeae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:37.035546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ec234-aead-4c84-8184-dff0bb6eeae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:37.045035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ec234-aead-4c84-8184-dff0bb6eeae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:37.046495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ec234-aead-4c84-8184-dff0bb6eeae0 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:37.055818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 877/1738] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:37.720192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff156889-c78a-4104-82c4-0261e748d2e8 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:37.721614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ff156889-c78a-4104-82c4-0261e748d2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:37.734483 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff156889-c78a-4104-82c4-0261e748d2e8 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:37.739018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3525dce-21b5-4592-b408-c97ac121368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:37.739870 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3525dce-21b5-4592-b408-c97ac121368a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:37.740203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3525dce-21b5-4592-b408-c97ac121368a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:37.740478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3525dce-21b5-4592-b408-c97ac121368a admin admin] PATH_INFO: `/v3/projects/3229bd50909b44cf8c935231048bde53` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:37.741728 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3525dce-21b5-4592-b408-c97ac121368a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3229bd50909b44cf8c935231048bde53)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:37.744310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3525dce-21b5-4592-b408-c97ac121368a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:37.844142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f3525dce-21b5-4592-b408-c97ac121368a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3229bd50909b44cf8c935231048bde53', 'request_id': 'req-f3525dce-21b5-4592-b408-c97ac121368a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:37.930758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f3525dce-21b5-4592-b408-c97ac121368a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3229bd50909b44cf8c935231048bde53', 'request_id': 'req-f3525dce-21b5-4592-b408-c97ac121368a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:37.936501 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f3525dce-21b5-4592-b408-c97ac121368a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3229bd50909b44cf8c935231048bde53', 'request_id': 'req-f3525dce-21b5-4592-b408-c97ac121368a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:37.947659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f3525dce-21b5-4592-b408-c97ac121368a admin admin] The token cache is being invalidate because project 3229bd50909b44cf8c935231048bde53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:37.947949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f3525dce-21b5-4592-b408-c97ac121368a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:37.948593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f3525dce-21b5-4592-b408-c97ac121368a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:37.950177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 862/1739] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:37 2021] DELETE /identity/v3/projects/3229bd50909b44cf8c935231048bde53 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:37.956602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9618b-c6d1-4af9-ae73-5b808036995f None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:37.957051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9618b-c6d1-4af9-ae73-5b808036995f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:37.957609 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9618b-c6d1-4af9-ae73-5b808036995f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:37.975725 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-f9a9618b-c6d1-4af9-ae73-5b808036995f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:37.977916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f9a9618b-c6d1-4af9-ae73-5b808036995f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:38.034093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 878/1740] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:38.042459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28b082-a697-4686-a565-59c47235d85f None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:38.042747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28b082-a697-4686-a565-59c47235d85f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:38.043024 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28b082-a697-4686-a565-59c47235d85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:38.060742 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-aa28b082-a697-4686-a565-59c47235d85f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:38.062052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-aa28b082-a697-4686-a565-59c47235d85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:38.069697 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 863/1741] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:38.073961 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9618b-c6d1-4af9-ae73-5b808036995f None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:38.083344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9618b-c6d1-4af9-ae73-5b808036995f None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:38.088712 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff01676-c273-4a3c-af66-30e1abc17fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:38.089359 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff01676-c273-4a3c-af66-30e1abc17fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:38.089643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff01676-c273-4a3c-af66-30e1abc17fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:38.089966 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff01676-c273-4a3c-af66-30e1abc17fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:38.090671 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff01676-c273-4a3c-af66-30e1abc17fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:36:38.090974 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff01676-c273-4a3c-af66-30e1abc17fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:38.095111 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff01676-c273-4a3c-af66-30e1abc17fb8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:38.104631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 879/1742] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:36:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:36:38.108919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28b082-a697-4686-a565-59c47235d85f None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:38.117821 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28b082-a697-4686-a565-59c47235d85f None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:38.122348 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493cb31-724d-4334-8925-3c3417ca9b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:38.122988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493cb31-724d-4334-8925-3c3417ca9b21 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:38.123264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493cb31-724d-4334-8925-3c3417ca9b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:38.123534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493cb31-724d-4334-8925-3c3417ca9b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:38.124214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493cb31-724d-4334-8925-3c3417ca9b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:38.126153 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493cb31-724d-4334-8925-3c3417ca9b21 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:38.240394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 864/1743] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:38 2021] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:38.244830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff01676-c273-4a3c-af66-30e1abc17fb8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:38.254725 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff01676-c273-4a3c-af66-30e1abc17fb8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:38.308737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e920d-f21d-47f9-badf-b5bdeb56e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:38.309330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e920d-f21d-47f9-badf-b5bdeb56e7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:38.309613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e920d-f21d-47f9-badf-b5bdeb56e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:38.309910 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e920d-f21d-47f9-badf-b5bdeb56e7d1 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:38.310596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e920d-f21d-47f9-badf-b5bdeb56e7d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:38.312558 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e920d-f21d-47f9-badf-b5bdeb56e7d1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:38.391339 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 880/1744] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:38 2021] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:36:38.392819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493cb31-724d-4334-8925-3c3417ca9b21 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:38.403687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493cb31-724d-4334-8925-3c3417ca9b21 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:38.408520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8756be-8ce2-4dcf-9576-f86bc4a7caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:38.409188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8756be-8ce2-4dcf-9576-f86bc4a7caac admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:38.409467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8756be-8ce2-4dcf-9576-f86bc4a7caac admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:38.409738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8756be-8ce2-4dcf-9576-f86bc4a7caac admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:38.410501 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8756be-8ce2-4dcf-9576-f86bc4a7caac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:38.412079 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8756be-8ce2-4dcf-9576-f86bc4a7caac admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:38.422632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 865/1745] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:38 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:36:38.426678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e920d-f21d-47f9-badf-b5bdeb56e7d1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:38.436786 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e920d-f21d-47f9-badf-b5bdeb56e7d1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:38.441425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab2c51-415f-4d93-9d4f-bb4bb94f1c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:38.442118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab2c51-415f-4d93-9d4f-bb4bb94f1c54 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:38.442403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab2c51-415f-4d93-9d4f-bb4bb94f1c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:38.442678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab2c51-415f-4d93-9d4f-bb4bb94f1c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:38.443400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab2c51-415f-4d93-9d4f-bb4bb94f1c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:38.445483 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab2c51-415f-4d93-9d4f-bb4bb94f1c54 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:38.455738 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 881/1746] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:38 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:38.460230 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8756be-8ce2-4dcf-9576-f86bc4a7caac admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:38.469908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8756be-8ce2-4dcf-9576-f86bc4a7caac admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:38.474706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096b441-ac91-4fa0-b36c-5bbf861490aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:38.476443 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096b441-ac91-4fa0-b36c-5bbf861490aa admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:38.476797 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096b441-ac91-4fa0-b36c-5bbf861490aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:38.477073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096b441-ac91-4fa0-b36c-5bbf861490aa admin admin] PATH_INFO: `/v3/projects/ac308eb4fff349d683ca17c21b061693/users/d2d9e9861052437b94c3baec65382bc1/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:38.491551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096b441-ac91-4fa0-b36c-5bbf861490aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac308eb4fff349d683ca17c21b061693, user_id=d2d9e9861052437b94c3baec65382bc1, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:38.494476 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096b441-ac91-4fa0-b36c-5bbf861490aa admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:38.565639 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 866/1747] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:38 2021] PUT /identity/v3/projects/ac308eb4fff349d683ca17c21b061693/users/d2d9e9861052437b94c3baec65382bc1/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:36:38.577710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a3464-10ca-4544-925d-d3a8e741dc2c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:38.577710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a3464-10ca-4544-925d-d3a8e741dc2c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:38.577933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a3464-10ca-4544-925d-d3a8e741dc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:38.612117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-442a3464-10ca-4544-925d-d3a8e741dc2c None None] MFA Rules not processed for user `d2d9e9861052437b94c3baec65382bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:38.613440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-442a3464-10ca-4544-925d-d3a8e741dc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:38.676984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 882/1748] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:38 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:38.681624 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096b441-ac91-4fa0-b36c-5bbf861490aa admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:38.747847 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096b441-ac91-4fa0-b36c-5bbf861490aa admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:38.752648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa963a-427d-4775-ad9f-6418b78be6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:38.753687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa963a-427d-4775-ad9f-6418b78be6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:38.754140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa963a-427d-4775-ad9f-6418b78be6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:38.754441 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa963a-427d-4775-ad9f-6418b78be6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:38.755137 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa963a-427d-4775-ad9f-6418b78be6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:38.757082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa963a-427d-4775-ad9f-6418b78be6b3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:38.863177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 867/1749] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:38 2021] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:38.867618 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a3464-10ca-4544-925d-d3a8e741dc2c None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:38.878040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a3464-10ca-4544-925d-d3a8e741dc2c None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:38.932178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c1811-de85-4354-bd46-368716f744c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:38.932861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c1811-de85-4354-bd46-368716f744c1 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:38.933142 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c1811-de85-4354-bd46-368716f744c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:38.933541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c1811-de85-4354-bd46-368716f744c1 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:38.934271 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c1811-de85-4354-bd46-368716f744c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:38.936205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c1811-de85-4354-bd46-368716f744c1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:39.021919 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 883/1750] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:38 2021] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:39.026399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa963a-427d-4775-ad9f-6418b78be6b3 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:39.036533 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa963a-427d-4775-ad9f-6418b78be6b3 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:39.041437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd45c3-6fa2-43a0-8e31-968849d5d364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:39.042134 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd45c3-6fa2-43a0-8e31-968849d5d364 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:39.042413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd45c3-6fa2-43a0-8e31-968849d5d364 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:39.042681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd45c3-6fa2-43a0-8e31-968849d5d364 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:39.043396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd45c3-6fa2-43a0-8e31-968849d5d364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:39.044960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd45c3-6fa2-43a0-8e31-968849d5d364 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:39.055139 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 868/1751] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:39 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:39.059279 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c1811-de85-4354-bd46-368716f744c1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:39.069060 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c1811-de85-4354-bd46-368716f744c1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:39.074289 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5287cad-557e-4b63-9fc6-5213dbb754d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:39.075157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5287cad-557e-4b63-9fc6-5213dbb754d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:39.075436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5287cad-557e-4b63-9fc6-5213dbb754d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:39.075713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5287cad-557e-4b63-9fc6-5213dbb754d9 admin admin] PATH_INFO: `/v3/projects/1b8093b683a44aa2a540d593347167c2/users/8308354b52854d6ca3e4b5a76c194506/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:39.090649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5287cad-557e-4b63-9fc6-5213dbb754d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8093b683a44aa2a540d593347167c2, user_id=8308354b52854d6ca3e4b5a76c194506, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:39.093526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5287cad-557e-4b63-9fc6-5213dbb754d9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:39.204928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 884/1752] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:39 2021] PUT /identity/v3/projects/1b8093b683a44aa2a540d593347167c2/users/8308354b52854d6ca3e4b5a76c194506/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:39.208860 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd45c3-6fa2-43a0-8e31-968849d5d364 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:39.219799 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd45c3-6fa2-43a0-8e31-968849d5d364 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:39.275387 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81e384-7a29-4c75-912b-288f09534998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:39.276054 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e384-7a29-4c75-912b-288f09534998 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:39.276336 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e384-7a29-4c75-912b-288f09534998 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:39.276612 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e384-7a29-4c75-912b-288f09534998 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:39.277336 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81e384-7a29-4c75-912b-288f09534998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:39.278978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81e384-7a29-4c75-912b-288f09534998 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:39.288439 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 869/1753] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:39 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:39.299746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5287cad-557e-4b63-9fc6-5213dbb754d9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:39.311049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5287cad-557e-4b63-9fc6-5213dbb754d9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:39.315799 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a586e62-564c-495c-a203-f82a45c6505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:39.316667 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a586e62-564c-495c-a203-f82a45c6505e admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:39.316942 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a586e62-564c-495c-a203-f82a45c6505e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:39.317209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a586e62-564c-495c-a203-f82a45c6505e admin admin] PATH_INFO: `/v3/projects/1b8093b683a44aa2a540d593347167c2/users/8308354b52854d6ca3e4b5a76c194506/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:39.319312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a586e62-564c-495c-a203-f82a45c6505e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8093b683a44aa2a540d593347167c2, user_id=8308354b52854d6ca3e4b5a76c194506, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:39.322608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a586e62-564c-495c-a203-f82a45c6505e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:39.332705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 885/1754] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:39 2021] PUT /identity/v3/projects/1b8093b683a44aa2a540d593347167c2/users/8308354b52854d6ca3e4b5a76c194506/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:39.342724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d468-2573-4708-a83f-7ef1002cf134 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:39.343018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d468-2573-4708-a83f-7ef1002cf134 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:39.343299 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d468-2573-4708-a83f-7ef1002cf134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:39.369569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0dd4d468-2573-4708-a83f-7ef1002cf134 None None] MFA Rules not processed for user `8308354b52854d6ca3e4b5a76c194506`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:39.370879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0dd4d468-2573-4708-a83f-7ef1002cf134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:39.435063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 870/1755] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:39 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:39.445396 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a586e62-564c-495c-a203-f82a45c6505e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:39.447640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2a586e62-564c-495c-a203-f82a45c6505e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:39.502782 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a586e62-564c-495c-a203-f82a45c6505e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:39.506422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52097c47-340d-4730-899e-7508b40464b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:39.507059 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52097c47-340d-4730-899e-7508b40464b4 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:39.508138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52097c47-340d-4730-899e-7508b40464b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:39.508274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52097c47-340d-4730-899e-7508b40464b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:39.516958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52097c47-340d-4730-899e-7508b40464b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:39.518478 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52097c47-340d-4730-899e-7508b40464b4 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:39.528212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 886/1756] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:39 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:40.256471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d468-2573-4708-a83f-7ef1002cf134 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:40.317520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d468-2573-4708-a83f-7ef1002cf134 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:40.322801 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:40.323709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:40.323989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:40.324376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] PATH_INFO: `/v3/users/d2d9e9861052437b94c3baec65382bc1` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:40.325553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d9e9861052437b94c3baec65382bc1)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:40.327500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:40.503817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d9e9861052437b94c3baec65382bc1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:40.504462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d9e9861052437b94c3baec65382bc1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:40.511052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d9e9861052437b94c3baec65382bc1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:40.576041 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d9e9861052437b94c3baec65382bc1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:40.588508 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d9e9861052437b94c3baec65382bc1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:40.594409 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 871/1757] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:40 2021] DELETE /identity/v3/users/d2d9e9861052437b94c3baec65382bc1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:40.599088 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d677e3c-44ec-4961-8028-ab4d63ccea2a None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:40.599517 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d677e3c-44ec-4961-8028-ab4d63ccea2a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:40.599758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d677e3c-44ec-4961-8028-ab4d63ccea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:40.618868 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0d677e3c-44ec-4961-8028-ab4d63ccea2a None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:40.620050 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0d677e3c-44ec-4961-8028-ab4d63ccea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:40.677398 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 887/1758] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:40.688232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:40.689798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:40.747443 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dce0d2-0f11-405d-a310-4b75b7bf86a5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:40.751340 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1aca8-2186-4115-a607-67d8cc9fe2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:40.751989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1aca8-2186-4115-a607-67d8cc9fe2fa service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:40.752274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1aca8-2186-4115-a607-67d8cc9fe2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:40.752550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1aca8-2186-4115-a607-67d8cc9fe2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:40.762774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1aca8-2186-4115-a607-67d8cc9fe2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:40.764194 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1aca8-2186-4115-a607-67d8cc9fe2fa service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:40.774279 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 872/1759] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:41.652300 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d677e3c-44ec-4961-8028-ab4d63ccea2a None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:41.654197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0d677e3c-44ec-4961-8028-ab4d63ccea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:41.666470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d677e3c-44ec-4961-8028-ab4d63ccea2a None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:41.671596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:41.672466 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:41.672751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:41.673029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] PATH_INFO: `/v3/projects/ac308eb4fff349d683ca17c21b061693` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:41.674243 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac308eb4fff349d683ca17c21b061693)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:41.676158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:41.793138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac308eb4fff349d683ca17c21b061693', 'request_id': 'req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:41.832822 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac308eb4fff349d683ca17c21b061693', 'request_id': 'req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:41.838371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac308eb4fff349d683ca17c21b061693', 'request_id': 'req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:41.849213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] The token cache is being invalidate because project ac308eb4fff349d683ca17c21b061693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:41.849504 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:41.850413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:41.852451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 888/1760] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:41 2021] DELETE /identity/v3/projects/ac308eb4fff349d683ca17c21b061693 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:41.856408 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1aca8-2186-4115-a607-67d8cc9fe2fa service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:41.865703 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1aca8-2186-4115-a607-67d8cc9fe2fa service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:41.919200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46d931-fc9c-4dbd-98b8-0d5429d69c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:41.919991 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46d931-fc9c-4dbd-98b8-0d5429d69c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:41.920268 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46d931-fc9c-4dbd-98b8-0d5429d69c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:41.920539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46d931-fc9c-4dbd-98b8-0d5429d69c8a admin admin] PATH_INFO: `/v3/users/8308354b52854d6ca3e4b5a76c194506` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:41.921699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46d931-fc9c-4dbd-98b8-0d5429d69c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8308354b52854d6ca3e4b5a76c194506)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:41.923667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46d931-fc9c-4dbd-98b8-0d5429d69c8a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:42.126333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0e46d931-fc9c-4dbd-98b8-0d5429d69c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8308354b52854d6ca3e4b5a76c194506'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:42.126987 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0e46d931-fc9c-4dbd-98b8-0d5429d69c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8308354b52854d6ca3e4b5a76c194506'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:42.133691 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0e46d931-fc9c-4dbd-98b8-0d5429d69c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8308354b52854d6ca3e4b5a76c194506'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:42.222031 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0e46d931-fc9c-4dbd-98b8-0d5429d69c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8308354b52854d6ca3e4b5a76c194506'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:42.235706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0e46d931-fc9c-4dbd-98b8-0d5429d69c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8308354b52854d6ca3e4b5a76c194506'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:42.242722 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 873/1761] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:41 2021] DELETE /identity/v3/users/8308354b52854d6ca3e4b5a76c194506 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:36:42.703425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:42.707386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:42.718596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b70300-fa61-4e8b-97d7-1010a44fe8b2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:42.775465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:42.776337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:42.776619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:42.776892 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce admin admin] PATH_INFO: `/v3/projects/1b8093b683a44aa2a540d593347167c2` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:42.778092 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8093b683a44aa2a540d593347167c2)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:42.779988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:42.889830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8093b683a44aa2a540d593347167c2', 'request_id': 'req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:42.956803 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8093b683a44aa2a540d593347167c2', 'request_id': 'req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:42.962501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8093b683a44aa2a540d593347167c2', 'request_id': 'req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:42.973273 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce admin admin] The token cache is being invalidate because project 1b8093b683a44aa2a540d593347167c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:42.973557 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:42.974201 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-64cc0c8b-6335-44e6-a06d-4ea88eb922ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:42.976512 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 889/1762] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:42 2021] DELETE /identity/v3/projects/1b8093b683a44aa2a540d593347167c2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:42.982504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e438289-0f97-4753-873a-2524bc4b5c12 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:42.982972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e438289-0f97-4753-873a-2524bc4b5c12 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:42.983172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e438289-0f97-4753-873a-2524bc4b5c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:43.001600 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0e438289-0f97-4753-873a-2524bc4b5c12 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:43.002824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0e438289-0f97-4753-873a-2524bc4b5c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:43.058456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 874/1763] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:43.068948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed00e2-374c-4738-98cc-f8ec71655034 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:43.069239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed00e2-374c-4738-98cc-f8ec71655034 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:43.069520 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed00e2-374c-4738-98cc-f8ec71655034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:43.088332 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-75ed00e2-374c-4738-98cc-f8ec71655034 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:43.090072 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-75ed00e2-374c-4738-98cc-f8ec71655034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:43.097268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 890/1764] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:43.102359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e438289-0f97-4753-873a-2524bc4b5c12 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:43.111869 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e438289-0f97-4753-873a-2524bc4b5c12 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:43.116557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba201a-65d2-4b24-b69c-aa51182f0ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:43.118655 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba201a-65d2-4b24-b69c-aa51182f0ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:43.118655 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba201a-65d2-4b24-b69c-aa51182f0ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:43.118655 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba201a-65d2-4b24-b69c-aa51182f0ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:43.118655 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba201a-65d2-4b24-b69c-aa51182f0ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:36:43.118987 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba201a-65d2-4b24-b69c-aa51182f0ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:43.120490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba201a-65d2-4b24-b69c-aa51182f0ff7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:43.132731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 875/1765] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:36:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:36:43.137223 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed00e2-374c-4738-98cc-f8ec71655034 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:43.146408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed00e2-374c-4738-98cc-f8ec71655034 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:43.151952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64c6dd-1069-4cf8-b16b-c1853be1cd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:43.152606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64c6dd-1069-4cf8-b16b-c1853be1cd18 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:43.152887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64c6dd-1069-4cf8-b16b-c1853be1cd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:43.153163 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64c6dd-1069-4cf8-b16b-c1853be1cd18 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:43.153849 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64c6dd-1069-4cf8-b16b-c1853be1cd18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:43.155764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64c6dd-1069-4cf8-b16b-c1853be1cd18 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:43.269562 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 891/1766] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:43 2021] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:36:43.270668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba201a-65d2-4b24-b69c-aa51182f0ff7 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:43.281796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba201a-65d2-4b24-b69c-aa51182f0ff7 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:43.336495 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b011dd9-e912-4566-b159-05b3f2cdf610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:43.337161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b011dd9-e912-4566-b159-05b3f2cdf610 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:43.337464 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b011dd9-e912-4566-b159-05b3f2cdf610 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:43.337757 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b011dd9-e912-4566-b159-05b3f2cdf610 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:43.338479 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b011dd9-e912-4566-b159-05b3f2cdf610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:43.340787 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b011dd9-e912-4566-b159-05b3f2cdf610 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:43.457398 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 876/1767] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:43 2021] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:36:43.458792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64c6dd-1069-4cf8-b16b-c1853be1cd18 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:43.473160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64c6dd-1069-4cf8-b16b-c1853be1cd18 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:43.480098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675cd7b-c146-468d-a282-6de0e023ce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:43.480974 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675cd7b-c146-468d-a282-6de0e023ce14 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:43.481354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675cd7b-c146-468d-a282-6de0e023ce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:43.481725 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675cd7b-c146-468d-a282-6de0e023ce14 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:43.487040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675cd7b-c146-468d-a282-6de0e023ce14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:43.489262 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675cd7b-c146-468d-a282-6de0e023ce14 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:43.509912 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 892/1768] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:43 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:43.513951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b011dd9-e912-4566-b159-05b3f2cdf610 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:43.526903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b011dd9-e912-4566-b159-05b3f2cdf610 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:43.532378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3dc18-c27b-4327-8e9a-1efbf4db99ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:43.533274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3dc18-c27b-4327-8e9a-1efbf4db99ac admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:43.533652 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3dc18-c27b-4327-8e9a-1efbf4db99ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:43.534018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3dc18-c27b-4327-8e9a-1efbf4db99ac admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:43.534964 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3dc18-c27b-4327-8e9a-1efbf4db99ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:43.536768 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3dc18-c27b-4327-8e9a-1efbf4db99ac admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:43.552689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 877/1769] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:43.554019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675cd7b-c146-468d-a282-6de0e023ce14 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:43.563846 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675cd7b-c146-468d-a282-6de0e023ce14 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:43.570701 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c905f-594c-45a1-8000-34c49880c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:43.571669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c905f-594c-45a1-8000-34c49880c094 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:43.572017 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c905f-594c-45a1-8000-34c49880c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:43.572359 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c905f-594c-45a1-8000-34c49880c094 admin admin] PATH_INFO: `/v3/projects/5dbec854bd0443e4be1819e546b167a0/users/cd19bfa2546f4daaaad43cd904caa23a/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:43.588148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c905f-594c-45a1-8000-34c49880c094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbec854bd0443e4be1819e546b167a0, user_id=cd19bfa2546f4daaaad43cd904caa23a, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:43.590966 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c905f-594c-45a1-8000-34c49880c094 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:43.666660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 893/1770] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:43 2021] PUT /identity/v3/projects/5dbec854bd0443e4be1819e546b167a0/users/cd19bfa2546f4daaaad43cd904caa23a/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:43.677125 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb382b8-2a68-4cb1-b2d4-ad760380a2f4 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:43.677415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb382b8-2a68-4cb1-b2d4-ad760380a2f4 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:43.677696 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb382b8-2a68-4cb1-b2d4-ad760380a2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:43.707868 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-fdb382b8-2a68-4cb1-b2d4-ad760380a2f4 None None] MFA Rules not processed for user `cd19bfa2546f4daaaad43cd904caa23a`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:43.707868 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-fdb382b8-2a68-4cb1-b2d4-ad760380a2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:43.772341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 878/1771] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:43 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:43.776977 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c905f-594c-45a1-8000-34c49880c094 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:43.837360 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c905f-594c-45a1-8000-34c49880c094 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:43.842146 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0042b-3451-470d-a5b6-1acb61ab1693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:43.842804 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0042b-3451-470d-a5b6-1acb61ab1693 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:43.843114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0042b-3451-470d-a5b6-1acb61ab1693 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:43.843345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0042b-3451-470d-a5b6-1acb61ab1693 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:43.844042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0042b-3451-470d-a5b6-1acb61ab1693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:43.845933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0042b-3451-470d-a5b6-1acb61ab1693 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:43.976340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 894/1772] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:43 2021] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:36:43.982855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb382b8-2a68-4cb1-b2d4-ad760380a2f4 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:43.991025 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb382b8-2a68-4cb1-b2d4-ad760380a2f4 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:44.045581 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910d912-46a9-4ece-9cbd-3e1cb814d0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:44.057302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910d912-46a9-4ece-9cbd-3e1cb814d0ad admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:44.057302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910d912-46a9-4ece-9cbd-3e1cb814d0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:44.057302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910d912-46a9-4ece-9cbd-3e1cb814d0ad admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:44.057302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910d912-46a9-4ece-9cbd-3e1cb814d0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:44.057302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910d912-46a9-4ece-9cbd-3e1cb814d0ad admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:44.156481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 879/1773] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:43 2021] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:44.160564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0042b-3451-470d-a5b6-1acb61ab1693 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:44.171470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0042b-3451-470d-a5b6-1acb61ab1693 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:44.176346 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd6a40-5404-43c9-8b82-90deb8d50248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:44.176995 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd6a40-5404-43c9-8b82-90deb8d50248 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:44.177276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd6a40-5404-43c9-8b82-90deb8d50248 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:44.177551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd6a40-5404-43c9-8b82-90deb8d50248 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:44.178308 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd6a40-5404-43c9-8b82-90deb8d50248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:44.180526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd6a40-5404-43c9-8b82-90deb8d50248 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:44.190988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 895/1774] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:44.199291 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910d912-46a9-4ece-9cbd-3e1cb814d0ad admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:44.208936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910d912-46a9-4ece-9cbd-3e1cb814d0ad admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:44.214042 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09aa09-63f0-4f8d-b7c4-fd76618cb546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:44.214942 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09aa09-63f0-4f8d-b7c4-fd76618cb546 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:44.215221 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09aa09-63f0-4f8d-b7c4-fd76618cb546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:44.215496 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09aa09-63f0-4f8d-b7c4-fd76618cb546 admin admin] PATH_INFO: `/v3/projects/c639234893024da8bfccb489d7cf1f62/users/13ceb111db794fff944b4918d02d44ec/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:44.230503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09aa09-63f0-4f8d-b7c4-fd76618cb546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c639234893024da8bfccb489d7cf1f62, user_id=13ceb111db794fff944b4918d02d44ec, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:44.233119 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09aa09-63f0-4f8d-b7c4-fd76618cb546 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:44.313255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 880/1775] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:44 2021] PUT /identity/v3/projects/c639234893024da8bfccb489d7cf1f62/users/13ceb111db794fff944b4918d02d44ec/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:44.319336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd6a40-5404-43c9-8b82-90deb8d50248 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:44.332124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd6a40-5404-43c9-8b82-90deb8d50248 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:44.386567 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b080e49-64f1-4d6c-8347-740de9a9b3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:44.387334 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080e49-64f1-4d6c-8347-740de9a9b3fa admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:44.387529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080e49-64f1-4d6c-8347-740de9a9b3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:44.387801 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080e49-64f1-4d6c-8347-740de9a9b3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:44.388519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b080e49-64f1-4d6c-8347-740de9a9b3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:44.390135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b080e49-64f1-4d6c-8347-740de9a9b3fa admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:44.400246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 896/1776] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:44 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:44.404496 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09aa09-63f0-4f8d-b7c4-fd76618cb546 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:44.415235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09aa09-63f0-4f8d-b7c4-fd76618cb546 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:44.420081 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600e9f4-6441-4603-bf2c-d8a624384ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:44.421003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600e9f4-6441-4603-bf2c-d8a624384ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:44.421282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600e9f4-6441-4603-bf2c-d8a624384ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:44.421551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600e9f4-6441-4603-bf2c-d8a624384ff9 admin admin] PATH_INFO: `/v3/projects/c639234893024da8bfccb489d7cf1f62/users/13ceb111db794fff944b4918d02d44ec/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:44.423525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600e9f4-6441-4603-bf2c-d8a624384ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c639234893024da8bfccb489d7cf1f62, user_id=13ceb111db794fff944b4918d02d44ec, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:44.427401 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600e9f4-6441-4603-bf2c-d8a624384ff9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:44.436817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 881/1777] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:44 2021] PUT /identity/v3/projects/c639234893024da8bfccb489d7cf1f62/users/13ceb111db794fff944b4918d02d44ec/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:36:44.446761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea788f25-9bda-4798-a3f0-6544115a3ab3 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:44.447069 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea788f25-9bda-4798-a3f0-6544115a3ab3 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:44.450428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea788f25-9bda-4798-a3f0-6544115a3ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:44.473423 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-ea788f25-9bda-4798-a3f0-6544115a3ab3 None None] MFA Rules not processed for user `13ceb111db794fff944b4918d02d44ec`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:44.474893 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ea788f25-9bda-4798-a3f0-6544115a3ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:44.557431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 897/1778] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:44 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:44.574527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600e9f4-6441-4603-bf2c-d8a624384ff9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:44.576187 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8600e9f4-6441-4603-bf2c-d8a624384ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:44.634514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600e9f4-6441-4603-bf2c-d8a624384ff9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:44.642561 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ad707-9f85-414d-afb6-726df785ba79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:44.643331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ad707-9f85-414d-afb6-726df785ba79 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:44.643686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ad707-9f85-414d-afb6-726df785ba79 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:44.644348 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ad707-9f85-414d-afb6-726df785ba79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:44.666326 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ad707-9f85-414d-afb6-726df785ba79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:44.667958 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ad707-9f85-414d-afb6-726df785ba79 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:44.680424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 882/1779] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:44 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:44.800214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea788f25-9bda-4798-a3f0-6544115a3ab3 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:44.801984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ea788f25-9bda-4798-a3f0-6544115a3ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:44.816919 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea788f25-9bda-4798-a3f0-6544115a3ab3 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:44.821041 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadfa64-7d74-44f5-84b3-34251cab3adb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:44.821778 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadfa64-7d74-44f5-84b3-34251cab3adb service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:44.822088 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadfa64-7d74-44f5-84b3-34251cab3adb service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:44.822362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadfa64-7d74-44f5-84b3-34251cab3adb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:44.911434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadfa64-7d74-44f5-84b3-34251cab3adb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:44.913900 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadfa64-7d74-44f5-84b3-34251cab3adb service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:44.930177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 898/1780] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:44 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:50.224837 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ad707-9f85-414d-afb6-726df785ba79 service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:50.284274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ad707-9f85-414d-afb6-726df785ba79 service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:50.288975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:50.294421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:50.294421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:50.294421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] PATH_INFO: `/v3/users/cd19bfa2546f4daaaad43cd904caa23a` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:50.294421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd19bfa2546f4daaaad43cd904caa23a)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:50.294421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:50.538213 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd19bfa2546f4daaaad43cd904caa23a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:50.538886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd19bfa2546f4daaaad43cd904caa23a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:50.545832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd19bfa2546f4daaaad43cd904caa23a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:50.656217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd19bfa2546f4daaaad43cd904caa23a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:50.671607 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd19bfa2546f4daaaad43cd904caa23a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:50.686922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 883/1781] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:50 2021] DELETE /identity/v3/users/cd19bfa2546f4daaaad43cd904caa23a => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:50.688921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb94a62-b316-4fba-8cfc-75b3ad15daeb None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:50.689408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb94a62-b316-4fba-8cfc-75b3ad15daeb None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:50.689501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb94a62-b316-4fba-8cfc-75b3ad15daeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:50.708369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-8fb94a62-b316-4fba-8cfc-75b3ad15daeb None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:50.709559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8fb94a62-b316-4fba-8cfc-75b3ad15daeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:50.767448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 899/1782] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:50.778095 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:50.779560 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:50.859751 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982ce64-5426-4735-9980-e0ff505968a9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:50.863347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23ba64-17f4-4ebd-8d8d-830c765dd753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:50.863996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23ba64-17f4-4ebd-8d8d-830c765dd753 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:50.864277 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23ba64-17f4-4ebd-8d8d-830c765dd753 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:50.864551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23ba64-17f4-4ebd-8d8d-830c765dd753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:50.875130 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23ba64-17f4-4ebd-8d8d-830c765dd753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:50.876569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23ba64-17f4-4ebd-8d8d-830c765dd753 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:50.887460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 884/1783] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:51.443717 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb94a62-b316-4fba-8cfc-75b3ad15daeb None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:51.445565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8fb94a62-b316-4fba-8cfc-75b3ad15daeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:51.459434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb94a62-b316-4fba-8cfc-75b3ad15daeb None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:51.468769 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:51.469838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:51.470152 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:51.470427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] PATH_INFO: `/v3/projects/5dbec854bd0443e4be1819e546b167a0` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:51.471624 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbec854bd0443e4be1819e546b167a0)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:51.473551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:51.584095 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbec854bd0443e4be1819e546b167a0', 'request_id': 'req-de82ee68-e440-4da8-8553-9e0b08077e48'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:51.655925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbec854bd0443e4be1819e546b167a0', 'request_id': 'req-de82ee68-e440-4da8-8553-9e0b08077e48'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:51.661839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbec854bd0443e4be1819e546b167a0', 'request_id': 'req-de82ee68-e440-4da8-8553-9e0b08077e48'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:51.673124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] The token cache is being invalidate because project 5dbec854bd0443e4be1819e546b167a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:51.673414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:51.674069 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:51.675622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 900/1784] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:51 2021] DELETE /identity/v3/projects/5dbec854bd0443e4be1819e546b167a0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:36:51.679735 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23ba64-17f4-4ebd-8d8d-830c765dd753 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:51.690466 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23ba64-17f4-4ebd-8d8d-830c765dd753 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:51.748905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d540d16-7ad2-49a6-937c-3efcb8f7ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:51.749785 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d540d16-7ad2-49a6-937c-3efcb8f7ed0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:51.750115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d540d16-7ad2-49a6-937c-3efcb8f7ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:51.750397 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d540d16-7ad2-49a6-937c-3efcb8f7ed0b admin admin] PATH_INFO: `/v3/users/13ceb111db794fff944b4918d02d44ec` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:51.751563 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d540d16-7ad2-49a6-937c-3efcb8f7ed0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ceb111db794fff944b4918d02d44ec)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:51.753473 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d540d16-7ad2-49a6-937c-3efcb8f7ed0b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:51.913689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-2d540d16-7ad2-49a6-937c-3efcb8f7ed0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ceb111db794fff944b4918d02d44ec'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:51.913689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-2d540d16-7ad2-49a6-937c-3efcb8f7ed0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ceb111db794fff944b4918d02d44ec'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:51.919558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-2d540d16-7ad2-49a6-937c-3efcb8f7ed0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ceb111db794fff944b4918d02d44ec'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:52.015615 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-2d540d16-7ad2-49a6-937c-3efcb8f7ed0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ceb111db794fff944b4918d02d44ec'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:52.029260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-2d540d16-7ad2-49a6-937c-3efcb8f7ed0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ceb111db794fff944b4918d02d44ec'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:52.035455 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 885/1785] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:51 2021] DELETE /identity/v3/users/13ceb111db794fff944b4918d02d44ec => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:52.663687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:52.665441 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:52.678976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82ee68-e440-4da8-8553-9e0b08077e48 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:52.744946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb2585-845c-46a7-bf00-2aec2dc323a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:52.745813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb2585-845c-46a7-bf00-2aec2dc323a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:52.746123 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb2585-845c-46a7-bf00-2aec2dc323a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:52.746398 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb2585-845c-46a7-bf00-2aec2dc323a3 admin admin] PATH_INFO: `/v3/projects/c639234893024da8bfccb489d7cf1f62` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:52.747582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb2585-845c-46a7-bf00-2aec2dc323a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c639234893024da8bfccb489d7cf1f62)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:52.749481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb2585-845c-46a7-bf00-2aec2dc323a3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:52.877483 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-b2cb2585-845c-46a7-bf00-2aec2dc323a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c639234893024da8bfccb489d7cf1f62', 'request_id': 'req-b2cb2585-845c-46a7-bf00-2aec2dc323a3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:52.939218 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-b2cb2585-845c-46a7-bf00-2aec2dc323a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c639234893024da8bfccb489d7cf1f62', 'request_id': 'req-b2cb2585-845c-46a7-bf00-2aec2dc323a3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:52.945536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-b2cb2585-845c-46a7-bf00-2aec2dc323a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c639234893024da8bfccb489d7cf1f62', 'request_id': 'req-b2cb2585-845c-46a7-bf00-2aec2dc323a3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:52.964359 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-b2cb2585-845c-46a7-bf00-2aec2dc323a3 admin admin] The token cache is being invalidate because project c639234893024da8bfccb489d7cf1f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:52.964885 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-b2cb2585-845c-46a7-bf00-2aec2dc323a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:52.965754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-b2cb2585-845c-46a7-bf00-2aec2dc323a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:52.967721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 901/1786] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:52 2021] DELETE /identity/v3/projects/c639234893024da8bfccb489d7cf1f62 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:52.973200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1983c-2073-4f3d-b9de-060eff0ff5c5 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:52.974091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1983c-2073-4f3d-b9de-060eff0ff5c5 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:52.974784 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1983c-2073-4f3d-b9de-060eff0ff5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:52.996630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-1bc1983c-2073-4f3d-b9de-060eff0ff5c5 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:52.998692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1bc1983c-2073-4f3d-b9de-060eff0ff5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:53.072063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 886/1787] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:53.083173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dedf44-40a8-4f48-9c69-3361d7c37057 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:53.083173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dedf44-40a8-4f48-9c69-3361d7c37057 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:53.083173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dedf44-40a8-4f48-9c69-3361d7c37057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:53.101352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-a7dedf44-40a8-4f48-9c69-3361d7c37057 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:53.103498 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a7dedf44-40a8-4f48-9c69-3361d7c37057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:53.114020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 902/1788] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:36:53.116465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1983c-2073-4f3d-b9de-060eff0ff5c5 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:53.126182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1983c-2073-4f3d-b9de-060eff0ff5c5 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:53.130746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1c1e2-3de6-4cf1-80f4-433c2b822eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:53.131383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1c1e2-3de6-4cf1-80f4-433c2b822eca admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:53.131660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1c1e2-3de6-4cf1-80f4-433c2b822eca admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:53.131931 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1c1e2-3de6-4cf1-80f4-433c2b822eca admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:53.132646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1c1e2-3de6-4cf1-80f4-433c2b822eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:36:53.133489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1c1e2-3de6-4cf1-80f4-433c2b822eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:53.135143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1c1e2-3de6-4cf1-80f4-433c2b822eca admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:53.146615 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 887/1789] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:36:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:36:53.151971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dedf44-40a8-4f48-9c69-3361d7c37057 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:53.160826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dedf44-40a8-4f48-9c69-3361d7c37057 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:53.165714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e78da-af09-4c6c-bd88-f04e7f4888a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:53.166397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e78da-af09-4c6c-bd88-f04e7f4888a0 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:53.166678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e78da-af09-4c6c-bd88-f04e7f4888a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:53.166949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e78da-af09-4c6c-bd88-f04e7f4888a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:53.167635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e78da-af09-4c6c-bd88-f04e7f4888a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:53.169554 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e78da-af09-4c6c-bd88-f04e7f4888a0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:53.234341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 903/1790] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:53 2021] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:53.238524 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1c1e2-3de6-4cf1-80f4-433c2b822eca admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:53.248321 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1c1e2-3de6-4cf1-80f4-433c2b822eca admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:53.303572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816452c-e2b1-4139-837b-0fc7db56c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:53.304256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816452c-e2b1-4139-837b-0fc7db56c234 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:53.304580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816452c-e2b1-4139-837b-0fc7db56c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:53.305353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816452c-e2b1-4139-837b-0fc7db56c234 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:53.306094 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816452c-e2b1-4139-837b-0fc7db56c234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:53.308106 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816452c-e2b1-4139-837b-0fc7db56c234 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:53.409136 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 888/1791] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:53 2021] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:36:53.413412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e78da-af09-4c6c-bd88-f04e7f4888a0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:53.424261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e78da-af09-4c6c-bd88-f04e7f4888a0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:53.430138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae029-a346-4106-b4c8-7c769eacef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:53.431366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae029-a346-4106-b4c8-7c769eacef08 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:53.431756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae029-a346-4106-b4c8-7c769eacef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:53.432107 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae029-a346-4106-b4c8-7c769eacef08 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:53.432959 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae029-a346-4106-b4c8-7c769eacef08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:53.434893 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae029-a346-4106-b4c8-7c769eacef08 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:53.453688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 904/1792] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:53 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:53.454677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816452c-e2b1-4139-837b-0fc7db56c234 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:53.466539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816452c-e2b1-4139-837b-0fc7db56c234 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:53.471571 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c11379-8fec-48ae-8e45-e445d350fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:53.472336 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c11379-8fec-48ae-8e45-e445d350fc79 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:53.472695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c11379-8fec-48ae-8e45-e445d350fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:53.473047 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c11379-8fec-48ae-8e45-e445d350fc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:53.473883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c11379-8fec-48ae-8e45-e445d350fc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:53.475871 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c11379-8fec-48ae-8e45-e445d350fc79 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:53.491457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 889/1793] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:53 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:36:53.496084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae029-a346-4106-b4c8-7c769eacef08 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:53.506553 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae029-a346-4106-b4c8-7c769eacef08 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:53.512043 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b15fde-609d-4971-b00a-7c31d0bbbcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:53.512928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b15fde-609d-4971-b00a-7c31d0bbbcc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:53.513231 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b15fde-609d-4971-b00a-7c31d0bbbcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:53.513502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b15fde-609d-4971-b00a-7c31d0bbbcc4 admin admin] PATH_INFO: `/v3/projects/df3715398481460b96553315ca7aa9ae/users/b12108ee279d4195a9b4aae311d3d6c0/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:53.527883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b15fde-609d-4971-b00a-7c31d0bbbcc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3715398481460b96553315ca7aa9ae, user_id=b12108ee279d4195a9b4aae311d3d6c0, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:53.530574 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b15fde-609d-4971-b00a-7c31d0bbbcc4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:53.615863 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 905/1794] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:53 2021] PUT /identity/v3/projects/df3715398481460b96553315ca7aa9ae/users/b12108ee279d4195a9b4aae311d3d6c0/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:53.618337 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7fc23-324d-4f11-bbcb-f4a441a05bc8 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:53.619003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7fc23-324d-4f11-bbcb-f4a441a05bc8 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:53.619294 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7fc23-324d-4f11-bbcb-f4a441a05bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:53.647474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-58d7fc23-324d-4f11-bbcb-f4a441a05bc8 None None] MFA Rules not processed for user `b12108ee279d4195a9b4aae311d3d6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:53.648800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-58d7fc23-324d-4f11-bbcb-f4a441a05bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:53.720777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 890/1795] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:53 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:53.725370 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b15fde-609d-4971-b00a-7c31d0bbbcc4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:53.789256 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b15fde-609d-4971-b00a-7c31d0bbbcc4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:53.794024 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6d507-b7c7-4bf3-ace8-51a95d65d870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:53.794682 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6d507-b7c7-4bf3-ace8-51a95d65d870 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:53.794966 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6d507-b7c7-4bf3-ace8-51a95d65d870 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:53.795239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6d507-b7c7-4bf3-ace8-51a95d65d870 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:53.796073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6d507-b7c7-4bf3-ace8-51a95d65d870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:53.797975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6d507-b7c7-4bf3-ace8-51a95d65d870 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:53.893135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 906/1796] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:53 2021] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:53.897034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7fc23-324d-4f11-bbcb-f4a441a05bc8 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:53.909600 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7fc23-324d-4f11-bbcb-f4a441a05bc8 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:53.980383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0f586-b338-4e25-8505-be244683f04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:53.981054 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0f586-b338-4e25-8505-be244683f04e admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:53.981338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0f586-b338-4e25-8505-be244683f04e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:53.981614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0f586-b338-4e25-8505-be244683f04e admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:53.982326 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0f586-b338-4e25-8505-be244683f04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:53.984241 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0f586-b338-4e25-8505-be244683f04e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:54.079319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 891/1797] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:36:53 2021] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:36:54.083390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6d507-b7c7-4bf3-ace8-51a95d65d870 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:54.101200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6d507-b7c7-4bf3-ace8-51a95d65d870 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:54.107150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbe3b5-84d1-464e-af5d-1333bedc232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:54.107816 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbe3b5-84d1-464e-af5d-1333bedc232a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:54.108098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbe3b5-84d1-464e-af5d-1333bedc232a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:54.108371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbe3b5-84d1-464e-af5d-1333bedc232a admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:54.109096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbe3b5-84d1-464e-af5d-1333bedc232a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:54.110739 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbe3b5-84d1-464e-af5d-1333bedc232a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:54.123356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 907/1798] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:54 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:36:54.134954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0f586-b338-4e25-8505-be244683f04e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:54.146242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0f586-b338-4e25-8505-be244683f04e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:54.151792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43236415-aac8-4939-b0a2-c74d8e5e8a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:54.152678 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43236415-aac8-4939-b0a2-c74d8e5e8a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:54.152997 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43236415-aac8-4939-b0a2-c74d8e5e8a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:54.153399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43236415-aac8-4939-b0a2-c74d8e5e8a75 admin admin] PATH_INFO: `/v3/projects/30e6413dcec94e1fa57ae80ff5466278/users/fc89d513f49d4eadbd1d008a58c8da8e/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:54.178595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43236415-aac8-4939-b0a2-c74d8e5e8a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e6413dcec94e1fa57ae80ff5466278, user_id=fc89d513f49d4eadbd1d008a58c8da8e, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:54.182034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43236415-aac8-4939-b0a2-c74d8e5e8a75 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:54.319205 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 892/1799] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:54 2021] PUT /identity/v3/projects/30e6413dcec94e1fa57ae80ff5466278/users/fc89d513f49d4eadbd1d008a58c8da8e/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:54.323473 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbe3b5-84d1-464e-af5d-1333bedc232a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:54.333609 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbe3b5-84d1-464e-af5d-1333bedc232a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:54.389957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1613f-0ce9-414e-b696-1db7ac6b1fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:54.390761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1613f-0ce9-414e-b696-1db7ac6b1fea admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:54.391045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1613f-0ce9-414e-b696-1db7ac6b1fea admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:54.391317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1613f-0ce9-414e-b696-1db7ac6b1fea admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:54.392090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1613f-0ce9-414e-b696-1db7ac6b1fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:54.393678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1613f-0ce9-414e-b696-1db7ac6b1fea admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:54.405933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 908/1800] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:36:54 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:36:54.416179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43236415-aac8-4939-b0a2-c74d8e5e8a75 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:54.426651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43236415-aac8-4939-b0a2-c74d8e5e8a75 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:54.432022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdec2a-ef1c-47ed-b523-09dd841ca47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:54.433040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdec2a-ef1c-47ed-b523-09dd841ca47a admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:54.433403 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdec2a-ef1c-47ed-b523-09dd841ca47a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:54.433772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdec2a-ef1c-47ed-b523-09dd841ca47a admin admin] PATH_INFO: `/v3/projects/30e6413dcec94e1fa57ae80ff5466278/users/fc89d513f49d4eadbd1d008a58c8da8e/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:54.435893 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdec2a-ef1c-47ed-b523-09dd841ca47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e6413dcec94e1fa57ae80ff5466278, user_id=fc89d513f49d4eadbd1d008a58c8da8e, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:54.438799 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdec2a-ef1c-47ed-b523-09dd841ca47a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:54.450769 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 893/1801] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:36:54 2021] PUT /identity/v3/projects/30e6413dcec94e1fa57ae80ff5466278/users/fc89d513f49d4eadbd1d008a58c8da8e/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:54.462272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017577-3415-403e-a2ad-fec434b8f8d6 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:54.462648 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017577-3415-403e-a2ad-fec434b8f8d6 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:54.462988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017577-3415-403e-a2ad-fec434b8f8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:54.490849 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-7b017577-3415-403e-a2ad-fec434b8f8d6 None None] MFA Rules not processed for user `fc89d513f49d4eadbd1d008a58c8da8e`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:54.492156 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7b017577-3415-403e-a2ad-fec434b8f8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:54.570762 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 909/1802] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:54 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:54.583428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdec2a-ef1c-47ed-b523-09dd841ca47a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:54.585851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7abdec2a-ef1c-47ed-b523-09dd841ca47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:54.654374 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdec2a-ef1c-47ed-b523-09dd841ca47a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:54.658264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21297a79-61f5-4d42-b2b2-35927fe75812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:54.658915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21297a79-61f5-4d42-b2b2-35927fe75812 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:54.659216 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21297a79-61f5-4d42-b2b2-35927fe75812 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:54.659480 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21297a79-61f5-4d42-b2b2-35927fe75812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:54.669891 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21297a79-61f5-4d42-b2b2-35927fe75812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:54.671478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21297a79-61f5-4d42-b2b2-35927fe75812 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:54.682416 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 894/1803] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:54 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:36:56.208470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b017577-3415-403e-a2ad-fec434b8f8d6 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:56.218371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b017577-3415-403e-a2ad-fec434b8f8d6 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:56.223157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68011592-beb9-426c-9166-99306c491437 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc89d513f49d4eadbd1d008a58c8da8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e6413dcec94e1fa57ae80ff5466278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:56.223827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68011592-beb9-426c-9166-99306c491437 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:56.224411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68011592-beb9-426c-9166-99306c491437 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:56.224689 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68011592-beb9-426c-9166-99306c491437 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:56.225457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68011592-beb9-426c-9166-99306c491437 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:36:56.236027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68011592-beb9-426c-9166-99306c491437 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:56.236027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68011592-beb9-426c-9166-99306c491437 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:56.264205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 910/1804] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:36:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:36:56.266363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21297a79-61f5-4d42-b2b2-35927fe75812 service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:56.276932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21297a79-61f5-4d42-b2b2-35927fe75812 service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:56.281631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36370a-2612-4a8c-92b4-6285c40ed6c5 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc89d513f49d4eadbd1d008a58c8da8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e6413dcec94e1fa57ae80ff5466278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:56.282359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36370a-2612-4a8c-92b4-6285c40ed6c5 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:56.282645 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36370a-2612-4a8c-92b4-6285c40ed6c5 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:56.282953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36370a-2612-4a8c-92b4-6285c40ed6c5 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:56.283608 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36370a-2612-4a8c-92b4-6285c40ed6c5 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:56.285503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36370a-2612-4a8c-92b4-6285c40ed6c5 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:56.394214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 895/1805] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:36:56 2021] POST /identity/v3/projects => generated 353 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:36:56.398385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68011592-beb9-426c-9166-99306c491437 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:56.409094 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68011592-beb9-426c-9166-99306c491437 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:56.464793 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405c8fb-e9e0-4eff-bd36-a7de32105f73 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc89d513f49d4eadbd1d008a58c8da8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e6413dcec94e1fa57ae80ff5466278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:56.465510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405c8fb-e9e0-4eff-bd36-a7de32105f73 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:56.465802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405c8fb-e9e0-4eff-bd36-a7de32105f73 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:56.466106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405c8fb-e9e0-4eff-bd36-a7de32105f73 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:56.466814 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405c8fb-e9e0-4eff-bd36-a7de32105f73 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:36:56.467119 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405c8fb-e9e0-4eff-bd36-a7de32105f73 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:56.468713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405c8fb-e9e0-4eff-bd36-a7de32105f73 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:56.480322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 911/1806] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:36:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:36:56.517363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36370a-2612-4a8c-92b4-6285c40ed6c5 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:56.527418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36370a-2612-4a8c-92b4-6285c40ed6c5 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:56.531906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37122c-0eee-431c-ad4c-6854cd879eb3 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc89d513f49d4eadbd1d008a58c8da8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e6413dcec94e1fa57ae80ff5466278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:56.533736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37122c-0eee-431c-ad4c-6854cd879eb3 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:56.535100 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37122c-0eee-431c-ad4c-6854cd879eb3 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:56.535100 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37122c-0eee-431c-ad4c-6854cd879eb3 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] PATH_INFO: `/v3/projects/3199829fa58b428db8bfedb1ac625207` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:56.535753 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37122c-0eee-431c-ad4c-6854cd879eb3 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3199829fa58b428db8bfedb1ac625207)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:56.537978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37122c-0eee-431c-ad4c-6854cd879eb3 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:56.639601 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-7c37122c-0eee-431c-ad4c-6854cd879eb3 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3199829fa58b428db8bfedb1ac625207', 'request_id': 'req-7c37122c-0eee-431c-ad4c-6854cd879eb3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:56.701660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-7c37122c-0eee-431c-ad4c-6854cd879eb3 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3199829fa58b428db8bfedb1ac625207', 'request_id': 'req-7c37122c-0eee-431c-ad4c-6854cd879eb3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:56.709134 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-7c37122c-0eee-431c-ad4c-6854cd879eb3 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3199829fa58b428db8bfedb1ac625207', 'request_id': 'req-7c37122c-0eee-431c-ad4c-6854cd879eb3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:56.723080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-7c37122c-0eee-431c-ad4c-6854cd879eb3 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] The token cache is being invalidate because project 3199829fa58b428db8bfedb1ac625207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:56.723444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-7c37122c-0eee-431c-ad4c-6854cd879eb3 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:56.724710 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-7c37122c-0eee-431c-ad4c-6854cd879eb3 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:56.726642 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 896/1807] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:56 2021] DELETE /identity/v3/projects/3199829fa58b428db8bfedb1ac625207 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:57.337797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405c8fb-e9e0-4eff-bd36-a7de32105f73 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:57.339596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c405c8fb-e9e0-4eff-bd36-a7de32105f73 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:57.406676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405c8fb-e9e0-4eff-bd36-a7de32105f73 tempest-VolumeQuotaClassesTest-1599724694 tempest-VolumeQuotaClassesTest-1599724694-project-admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:57.462875 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:57.463751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:57.464033 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:57.464306 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] PATH_INFO: `/v3/users/b12108ee279d4195a9b4aae311d3d6c0` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:57.465574 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12108ee279d4195a9b4aae311d3d6c0)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:57.467495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:57.674580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12108ee279d4195a9b4aae311d3d6c0'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:57.675219 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12108ee279d4195a9b4aae311d3d6c0'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:57.675862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12108ee279d4195a9b4aae311d3d6c0'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:57.774301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12108ee279d4195a9b4aae311d3d6c0'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:57.796399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12108ee279d4195a9b4aae311d3d6c0'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:57.811811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 912/1808] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:57 2021] DELETE /identity/v3/users/b12108ee279d4195a9b4aae311d3d6c0 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:57.816115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed63ea-ff03-4178-aceb-1e2231ab4393 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:57.816567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed63ea-ff03-4178-aceb-1e2231ab4393 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:57.816660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed63ea-ff03-4178-aceb-1e2231ab4393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:57.835555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-d9ed63ea-ff03-4178-aceb-1e2231ab4393 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:57.837584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d9ed63ea-ff03-4178-aceb-1e2231ab4393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:57.905841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 897/1809] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:57.917212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:57.918560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:57.984135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323b80f-3307-4b19-9b3c-ff4681800b9f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:57.987929 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2cdae-a1ec-4410-a285-763df89c2b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:57.988594 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2cdae-a1ec-4410-a285-763df89c2b05 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:57.988873 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2cdae-a1ec-4410-a285-763df89c2b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:57.989153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2cdae-a1ec-4410-a285-763df89c2b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:57.998896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2cdae-a1ec-4410-a285-763df89c2b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:58.000326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2cdae-a1ec-4410-a285-763df89c2b05 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:58.010999 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 913/1810] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:36:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:36:58.483971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed63ea-ff03-4178-aceb-1e2231ab4393 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:58.486023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d9ed63ea-ff03-4178-aceb-1e2231ab4393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:58.500390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed63ea-ff03-4178-aceb-1e2231ab4393 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:58.505331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:58.506256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:58.506799 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:58.507165 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] PATH_INFO: `/v3/projects/df3715398481460b96553315ca7aa9ae` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:58.515500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3715398481460b96553315ca7aa9ae)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:58.520948 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:58.642750 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3715398481460b96553315ca7aa9ae', 'request_id': 'req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:58.729928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3715398481460b96553315ca7aa9ae', 'request_id': 'req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:58.735922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3715398481460b96553315ca7aa9ae', 'request_id': 'req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:58.747240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] The token cache is being invalidate because project df3715398481460b96553315ca7aa9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:58.747513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:58.748331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:58.749903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 898/1811] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:58 2021] DELETE /identity/v3/projects/df3715398481460b96553315ca7aa9ae => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:58.754025 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2cdae-a1ec-4410-a285-763df89c2b05 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:58.764406 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2cdae-a1ec-4410-a285-763df89c2b05 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:58.832090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591db57-acda-4f86-80a4-d81a33bd546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:58.833257 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591db57-acda-4f86-80a4-d81a33bd546f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:58.833703 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591db57-acda-4f86-80a4-d81a33bd546f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:58.834115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591db57-acda-4f86-80a4-d81a33bd546f admin admin] PATH_INFO: `/v3/users/fc89d513f49d4eadbd1d008a58c8da8e` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:58.835447 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591db57-acda-4f86-80a4-d81a33bd546f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc89d513f49d4eadbd1d008a58c8da8e)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:58.838240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591db57-acda-4f86-80a4-d81a33bd546f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:59.018408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7591db57-acda-4f86-80a4-d81a33bd546f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc89d513f49d4eadbd1d008a58c8da8e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:59.019262 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7591db57-acda-4f86-80a4-d81a33bd546f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc89d513f49d4eadbd1d008a58c8da8e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:59.019865 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7591db57-acda-4f86-80a4-d81a33bd546f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc89d513f49d4eadbd1d008a58c8da8e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:59.136662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7591db57-acda-4f86-80a4-d81a33bd546f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc89d513f49d4eadbd1d008a58c8da8e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:59.156090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7591db57-acda-4f86-80a4-d81a33bd546f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc89d513f49d4eadbd1d008a58c8da8e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:59.177679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 914/1812] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:36:58 2021] DELETE /identity/v3/users/fc89d513f49d4eadbd1d008a58c8da8e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:59.594541 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:36:59.596197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:59.613482 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3ca40-ca69-4de0-8bc9-609a6182fd06 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:36:59.672573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ab19e-ef87-4bc0-8105-8b5748725f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:36:59.673435 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ab19e-ef87-4bc0-8105-8b5748725f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:59.673834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ab19e-ef87-4bc0-8105-8b5748725f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:59.674131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ab19e-ef87-4bc0-8105-8b5748725f87 admin admin] PATH_INFO: `/v3/projects/30e6413dcec94e1fa57ae80ff5466278` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:59.675314 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ab19e-ef87-4bc0-8105-8b5748725f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e6413dcec94e1fa57ae80ff5466278)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:36:59.677336 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ab19e-ef87-4bc0-8105-8b5748725f87 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:36:59.775307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d85ab19e-ef87-4bc0-8105-8b5748725f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e6413dcec94e1fa57ae80ff5466278', 'request_id': 'req-d85ab19e-ef87-4bc0-8105-8b5748725f87'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:59.859360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d85ab19e-ef87-4bc0-8105-8b5748725f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e6413dcec94e1fa57ae80ff5466278', 'request_id': 'req-d85ab19e-ef87-4bc0-8105-8b5748725f87'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:59.865826 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d85ab19e-ef87-4bc0-8105-8b5748725f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e6413dcec94e1fa57ae80ff5466278', 'request_id': 'req-d85ab19e-ef87-4bc0-8105-8b5748725f87'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:59.876850 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d85ab19e-ef87-4bc0-8105-8b5748725f87 admin admin] The token cache is being invalidate because project 30e6413dcec94e1fa57ae80ff5466278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:36:59.877141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d85ab19e-ef87-4bc0-8105-8b5748725f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:59.877792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d85ab19e-ef87-4bc0-8105-8b5748725f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:36:59.884203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 899/1813] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:36:59 2021] DELETE /identity/v3/projects/30e6413dcec94e1fa57ae80ff5466278 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:36:59.885996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d1afe-7719-405d-93ca-ad62cff07c4d None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:59.886705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d1afe-7719-405d-93ca-ad62cff07c4d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:59.886985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d1afe-7719-405d-93ca-ad62cff07c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:36:59.910181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-401d1afe-7719-405d-93ca-ad62cff07c4d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:36:59.911751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-401d1afe-7719-405d-93ca-ad62cff07c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:36:59.977508 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 915/1814] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:36:59.985429 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee49ff-7b32-471c-8ec7-89d86d446193 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:36:59.985616 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee49ff-7b32-471c-8ec7-89d86d446193 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:36:59.985920 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee49ff-7b32-471c-8ec7-89d86d446193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:00.006154 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-6aee49ff-7b32-471c-8ec7-89d86d446193 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:00.007317 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-6aee49ff-7b32-471c-8ec7-89d86d446193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:00.015822 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 900/1815] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:36:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:00.020153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d1afe-7719-405d-93ca-ad62cff07c4d None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:00.034370 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d1afe-7719-405d-93ca-ad62cff07c4d None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:00.040268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a443a-4507-40ff-a12b-e3219cec05da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:00.041064 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a443a-4507-40ff-a12b-e3219cec05da admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:00.041593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a443a-4507-40ff-a12b-e3219cec05da admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:00.042002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a443a-4507-40ff-a12b-e3219cec05da admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:00.042820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a443a-4507-40ff-a12b-e3219cec05da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:37:00.043221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a443a-4507-40ff-a12b-e3219cec05da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:00.045131 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a443a-4507-40ff-a12b-e3219cec05da admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:00.065034 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 916/1816] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:37:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:37:00.069149 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee49ff-7b32-471c-8ec7-89d86d446193 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:00.082059 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee49ff-7b32-471c-8ec7-89d86d446193 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:00.088568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be719c0-0506-4213-a168-b7c091e9af74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:00.089680 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be719c0-0506-4213-a168-b7c091e9af74 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:00.090140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be719c0-0506-4213-a168-b7c091e9af74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:00.090541 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be719c0-0506-4213-a168-b7c091e9af74 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:00.091386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be719c0-0506-4213-a168-b7c091e9af74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:00.093425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be719c0-0506-4213-a168-b7c091e9af74 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:00.254771 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 901/1817] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:00 2021] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:00.259607 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a443a-4507-40ff-a12b-e3219cec05da admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:00.276334 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a443a-4507-40ff-a12b-e3219cec05da admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:00.341055 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3cda3-ca22-48b8-974b-7998ecdfd1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:00.341735 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3cda3-ca22-48b8-974b-7998ecdfd1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:00.342061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3cda3-ca22-48b8-974b-7998ecdfd1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:00.342338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3cda3-ca22-48b8-974b-7998ecdfd1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:00.343052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3cda3-ca22-48b8-974b-7998ecdfd1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:00.345058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3cda3-ca22-48b8-974b-7998ecdfd1d5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:00.459225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 917/1818] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:00 2021] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:00.463922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be719c0-0506-4213-a168-b7c091e9af74 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:00.474143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be719c0-0506-4213-a168-b7c091e9af74 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:00.479201 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df785c8c-4249-432a-a47c-d3499ae39335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:00.479849 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df785c8c-4249-432a-a47c-d3499ae39335 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:00.480172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df785c8c-4249-432a-a47c-d3499ae39335 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:00.480496 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df785c8c-4249-432a-a47c-d3499ae39335 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:00.481373 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df785c8c-4249-432a-a47c-d3499ae39335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:00.482976 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df785c8c-4249-432a-a47c-d3499ae39335 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:00.493831 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 902/1819] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:37:00.497786 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3cda3-ca22-48b8-974b-7998ecdfd1d5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:00.508345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3cda3-ca22-48b8-974b-7998ecdfd1d5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:00.514173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22d3fa-74b0-4de6-9c04-b3f583a2a963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:00.514173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22d3fa-74b0-4de6-9c04-b3f583a2a963 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:00.514173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22d3fa-74b0-4de6-9c04-b3f583a2a963 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:00.514463 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22d3fa-74b0-4de6-9c04-b3f583a2a963 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:00.514944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22d3fa-74b0-4de6-9c04-b3f583a2a963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:00.516542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22d3fa-74b0-4de6-9c04-b3f583a2a963 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:00.526588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 918/1820] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:00.531115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df785c8c-4249-432a-a47c-d3499ae39335 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:00.541970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df785c8c-4249-432a-a47c-d3499ae39335 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:00.546617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb4476-775e-4cb2-ac41-2a1205e3cb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:00.547520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb4476-775e-4cb2-ac41-2a1205e3cb02 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:00.547794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb4476-775e-4cb2-ac41-2a1205e3cb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:00.548059 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb4476-775e-4cb2-ac41-2a1205e3cb02 admin admin] PATH_INFO: `/v3/projects/06d476d68e724afb9afec16d885b8d5f/users/89d534b74bb74771b85cf05215c8849b/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:00.563111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb4476-775e-4cb2-ac41-2a1205e3cb02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d476d68e724afb9afec16d885b8d5f, user_id=89d534b74bb74771b85cf05215c8849b, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:00.565790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb4476-775e-4cb2-ac41-2a1205e3cb02 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:00.674492 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 903/1821] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:00 2021] PUT /identity/v3/projects/06d476d68e724afb9afec16d885b8d5f/users/89d534b74bb74771b85cf05215c8849b/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:00.681230 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea8ed1-004c-40c1-b997-7eb40b523c66 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:00.681528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea8ed1-004c-40c1-b997-7eb40b523c66 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:00.681803 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea8ed1-004c-40c1-b997-7eb40b523c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:00.714665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-76ea8ed1-004c-40c1-b997-7eb40b523c66 None None] MFA Rules not processed for user `89d534b74bb74771b85cf05215c8849b`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:00.716035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-76ea8ed1-004c-40c1-b997-7eb40b523c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:00.788314 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 919/1822] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:00 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:00.793507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb4476-775e-4cb2-ac41-2a1205e3cb02 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:00.868772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb4476-775e-4cb2-ac41-2a1205e3cb02 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:00.873504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2327-f14c-4491-821f-3ca3ba1c4ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:00.874213 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2327-f14c-4491-821f-3ca3ba1c4ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:00.874498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2327-f14c-4491-821f-3ca3ba1c4ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:00.874774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2327-f14c-4491-821f-3ca3ba1c4ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:00.875461 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc2327-f14c-4491-821f-3ca3ba1c4ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:00.877385 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc2327-f14c-4491-821f-3ca3ba1c4ea7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:00.984062 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 904/1823] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:00 2021] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:00.988272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea8ed1-004c-40c1-b997-7eb40b523c66 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:01.003407 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea8ed1-004c-40c1-b997-7eb40b523c66 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:01.087295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d71418-52c4-4827-98ba-1b827a5170af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:01.089006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d71418-52c4-4827-98ba-1b827a5170af admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:01.089006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d71418-52c4-4827-98ba-1b827a5170af admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:01.089006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d71418-52c4-4827-98ba-1b827a5170af admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:01.089389 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d71418-52c4-4827-98ba-1b827a5170af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:01.091802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d71418-52c4-4827-98ba-1b827a5170af admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:01.178809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 920/1824] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:00 2021] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:01.182960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2327-f14c-4491-821f-3ca3ba1c4ea7 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:01.192760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2327-f14c-4491-821f-3ca3ba1c4ea7 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:01.197360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98bea6-27ff-42df-b41b-5b2698411d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:01.198045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98bea6-27ff-42df-b41b-5b2698411d30 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:01.198325 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98bea6-27ff-42df-b41b-5b2698411d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:01.198597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98bea6-27ff-42df-b41b-5b2698411d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:01.199310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98bea6-27ff-42df-b41b-5b2698411d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:01.200879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98bea6-27ff-42df-b41b-5b2698411d30 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:01.211774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 905/1825] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:37:01.215758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d71418-52c4-4827-98ba-1b827a5170af admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:01.225856 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d71418-52c4-4827-98ba-1b827a5170af admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:01.231225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6524d8-b9af-4257-8260-e7ca1c1ca975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:01.231893 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6524d8-b9af-4257-8260-e7ca1c1ca975 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:01.232238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6524d8-b9af-4257-8260-e7ca1c1ca975 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:01.232517 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6524d8-b9af-4257-8260-e7ca1c1ca975 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:01.233251 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6524d8-b9af-4257-8260-e7ca1c1ca975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:01.234877 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6524d8-b9af-4257-8260-e7ca1c1ca975 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:01.245973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 921/1826] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:01.250319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98bea6-27ff-42df-b41b-5b2698411d30 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:01.260434 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98bea6-27ff-42df-b41b-5b2698411d30 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:01.265088 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd373b-00e0-4967-b091-7a7a142c141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:01.265988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd373b-00e0-4967-b091-7a7a142c141d admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:01.266261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd373b-00e0-4967-b091-7a7a142c141d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:01.266528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd373b-00e0-4967-b091-7a7a142c141d admin admin] PATH_INFO: `/v3/projects/1fe951b0e4ca45b9b1a2e06a0d2da727/users/e258a59e4db4494a9af0979116c80c38/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:01.282629 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd373b-00e0-4967-b091-7a7a142c141d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe951b0e4ca45b9b1a2e06a0d2da727, user_id=e258a59e4db4494a9af0979116c80c38, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:01.285296 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd373b-00e0-4967-b091-7a7a142c141d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:01.399360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 906/1827] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:01 2021] PUT /identity/v3/projects/1fe951b0e4ca45b9b1a2e06a0d2da727/users/e258a59e4db4494a9af0979116c80c38/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:01.421546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312b3d7-8827-4ee0-9b4c-22439a5314d9 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:01.421852 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312b3d7-8827-4ee0-9b4c-22439a5314d9 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:01.422538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312b3d7-8827-4ee0-9b4c-22439a5314d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:01.485812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-8312b3d7-8827-4ee0-9b4c-22439a5314d9 None None] MFA Rules not processed for user `e258a59e4db4494a9af0979116c80c38`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:01.485812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8312b3d7-8827-4ee0-9b4c-22439a5314d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:01.575377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 922/1828] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:01 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:01.587823 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd373b-00e0-4967-b091-7a7a142c141d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:01.662500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd373b-00e0-4967-b091-7a7a142c141d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:01.674196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c03fc9-f8e6-4b84-909c-74f2a3cb298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:01.674862 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c03fc9-f8e6-4b84-909c-74f2a3cb298e admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:01.675430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c03fc9-f8e6-4b84-909c-74f2a3cb298e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:01.675430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c03fc9-f8e6-4b84-909c-74f2a3cb298e admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:01.676076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c03fc9-f8e6-4b84-909c-74f2a3cb298e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:01.678055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c03fc9-f8e6-4b84-909c-74f2a3cb298e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:01.788577 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 907/1829] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:01 2021] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:01.792741 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312b3d7-8827-4ee0-9b4c-22439a5314d9 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:01.803388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312b3d7-8827-4ee0-9b4c-22439a5314d9 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:01.857874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b109536-a17c-4f03-ae7e-13acbdde4ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:01.858555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b109536-a17c-4f03-ae7e-13acbdde4ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:01.858830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b109536-a17c-4f03-ae7e-13acbdde4ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:01.859096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b109536-a17c-4f03-ae7e-13acbdde4ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:01.859780 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b109536-a17c-4f03-ae7e-13acbdde4ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:01.861675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b109536-a17c-4f03-ae7e-13acbdde4ec1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:01.999175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 923/1830] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:01 2021] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:02.001259 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c03fc9-f8e6-4b84-909c-74f2a3cb298e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:02.012504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c03fc9-f8e6-4b84-909c-74f2a3cb298e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:02.017393 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f74b27-118b-4ec8-bf15-de3ea26941d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:02.018093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f74b27-118b-4ec8-bf15-de3ea26941d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:02.018376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f74b27-118b-4ec8-bf15-de3ea26941d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:02.018651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f74b27-118b-4ec8-bf15-de3ea26941d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:02.019370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f74b27-118b-4ec8-bf15-de3ea26941d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:02.021228 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f74b27-118b-4ec8-bf15-de3ea26941d4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:02.033806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 908/1831] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:02 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:02.047450 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b109536-a17c-4f03-ae7e-13acbdde4ec1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:02.061018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b109536-a17c-4f03-ae7e-13acbdde4ec1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:02.065785 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e280b7-b158-48c8-ad53-2ffb527b98ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:02.066801 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e280b7-b158-48c8-ad53-2ffb527b98ba admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:02.067080 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e280b7-b158-48c8-ad53-2ffb527b98ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:02.067355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e280b7-b158-48c8-ad53-2ffb527b98ba admin admin] PATH_INFO: `/v3/projects/7eef5742f042495385deda0a6dfa71f0/users/2e36601074d64400aa0b804e745ef813/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:02.083059 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e280b7-b158-48c8-ad53-2ffb527b98ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eef5742f042495385deda0a6dfa71f0, user_id=2e36601074d64400aa0b804e745ef813, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:02.086177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e280b7-b158-48c8-ad53-2ffb527b98ba admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:02.221963 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 924/1832] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:02 2021] PUT /identity/v3/projects/7eef5742f042495385deda0a6dfa71f0/users/2e36601074d64400aa0b804e745ef813/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:02.225850 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f74b27-118b-4ec8-bf15-de3ea26941d4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:02.236718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f74b27-118b-4ec8-bf15-de3ea26941d4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:02.307161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1304b-58ce-442a-8a1d-a2d9abbe7152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:02.307857 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1304b-58ce-442a-8a1d-a2d9abbe7152 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:02.308142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1304b-58ce-442a-8a1d-a2d9abbe7152 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:02.308409 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1304b-58ce-442a-8a1d-a2d9abbe7152 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:02.309304 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1304b-58ce-442a-8a1d-a2d9abbe7152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:02.311011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1304b-58ce-442a-8a1d-a2d9abbe7152 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:02.322043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 909/1833] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:02 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:02.326027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e280b7-b158-48c8-ad53-2ffb527b98ba admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:02.338089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e280b7-b158-48c8-ad53-2ffb527b98ba admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:02.343406 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae3f8d-3072-44a1-abe0-019e4cf0954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:02.344363 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae3f8d-3072-44a1-abe0-019e4cf0954e admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:02.344708 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae3f8d-3072-44a1-abe0-019e4cf0954e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:02.345044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae3f8d-3072-44a1-abe0-019e4cf0954e admin admin] PATH_INFO: `/v3/projects/7eef5742f042495385deda0a6dfa71f0/users/2e36601074d64400aa0b804e745ef813/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:02.347259 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae3f8d-3072-44a1-abe0-019e4cf0954e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eef5742f042495385deda0a6dfa71f0, user_id=2e36601074d64400aa0b804e745ef813, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:02.350269 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae3f8d-3072-44a1-abe0-019e4cf0954e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:02.361424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 925/1834] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:02 2021] PUT /identity/v3/projects/7eef5742f042495385deda0a6dfa71f0/users/2e36601074d64400aa0b804e745ef813/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:02.372369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e71f4-7911-4d20-ab46-dbd167d8a7a7 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:02.372666 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e71f4-7911-4d20-ab46-dbd167d8a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:02.372941 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e71f4-7911-4d20-ab46-dbd167d8a7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:02.405657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-b29e71f4-7911-4d20-ab46-dbd167d8a7a7 None None] MFA Rules not processed for user `2e36601074d64400aa0b804e745ef813`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:02.407678 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b29e71f4-7911-4d20-ab46-dbd167d8a7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:02.482005 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 910/1835] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:02 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:02.492642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae3f8d-3072-44a1-abe0-019e4cf0954e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:02.494415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ebae3f8d-3072-44a1-abe0-019e4cf0954e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:02.550112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae3f8d-3072-44a1-abe0-019e4cf0954e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:02.553956 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb0d41-58d7-4223-b37d-9f9c94af6d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:02.555005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb0d41-58d7-4223-b37d-9f9c94af6d9a service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:02.555273 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb0d41-58d7-4223-b37d-9f9c94af6d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:02.555550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb0d41-58d7-4223-b37d-9f9c94af6d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:02.566151 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb0d41-58d7-4223-b37d-9f9c94af6d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:02.575390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb0d41-58d7-4223-b37d-9f9c94af6d9a service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:02.579038 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 926/1836] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:02 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:02.795810 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e71f4-7911-4d20-ab46-dbd167d8a7a7 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:02.806967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e71f4-7911-4d20-ab46-dbd167d8a7a7 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:02.813320 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b3932-c2e0-41f6-8e31-0b4199eacad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:02.814024 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b3932-c2e0-41f6-8e31-0b4199eacad7 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:02.814436 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b3932-c2e0-41f6-8e31-0b4199eacad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:02.814575 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b3932-c2e0-41f6-8e31-0b4199eacad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:02.875038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b3932-c2e0-41f6-8e31-0b4199eacad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:02.876503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b3932-c2e0-41f6-8e31-0b4199eacad7 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:02.885945 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 911/1837] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:02 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:03.578844 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db10b3-998f-4e8c-8472-4471dd8a3d41 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:03.579458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db10b3-998f-4e8c-8472-4471dd8a3d41 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:03.579458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db10b3-998f-4e8c-8472-4471dd8a3d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:03.596927 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-32db10b3-998f-4e8c-8472-4471dd8a3d41 None None] MFA Rules not processed for user `569387965b184cc3a1bc2aecdbede0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:03.598151 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-32db10b3-998f-4e8c-8472-4471dd8a3d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:03.652389 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 927/1838] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:03 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:05.583120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b3932-c2e0-41f6-8e31-0b4199eacad7 service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:05.585389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-148b3932-c2e0-41f6-8e31-0b4199eacad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:05.652382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b3932-c2e0-41f6-8e31-0b4199eacad7 service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:05.657110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:05.658122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:05.658402 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:05.658677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] PATH_INFO: `/v3/users/928471014e704162920136ac0336dff3` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:05.659913 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=928471014e704162920136ac0336dff3)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:05.661809 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:05.869034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928471014e704162920136ac0336dff3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:05.869830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928471014e704162920136ac0336dff3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:05.878459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928471014e704162920136ac0336dff3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:05.952717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928471014e704162920136ac0336dff3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:05.964934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928471014e704162920136ac0336dff3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:05.970805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 912/1839] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:05 2021] DELETE /identity/v3/users/928471014e704162920136ac0336dff3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:05.975632 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eda223-66bd-4350-95e1-80528dd11b1b None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:05.976589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eda223-66bd-4350-95e1-80528dd11b1b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:05.976876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eda223-66bd-4350-95e1-80528dd11b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:05.996179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-46eda223-66bd-4350-95e1-80528dd11b1b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:05.997949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-46eda223-66bd-4350-95e1-80528dd11b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:06.059078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 928/1840] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:06.069275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:06.070933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:06.133107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc195efa-25fd-409d-bdd1-49579615bc81 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:06.138075 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9c891-5b9e-4b97-90f7-44e975bad9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:06.138730 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c891-5b9e-4b97-90f7-44e975bad9dc service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:06.139016 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c891-5b9e-4b97-90f7-44e975bad9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:06.139319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c891-5b9e-4b97-90f7-44e975bad9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:06.149583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9c891-5b9e-4b97-90f7-44e975bad9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:06.151064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9c891-5b9e-4b97-90f7-44e975bad9dc service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:06.161217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 913/1841] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:06.581924 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eda223-66bd-4350-95e1-80528dd11b1b None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:06.583932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-46eda223-66bd-4350-95e1-80528dd11b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:06.598058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eda223-66bd-4350-95e1-80528dd11b1b None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:06.604286 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f996d-1257-4640-b212-bb5720830e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:06.606948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f996d-1257-4640-b212-bb5720830e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:06.606948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f996d-1257-4640-b212-bb5720830e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:06.606948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f996d-1257-4640-b212-bb5720830e2d admin admin] PATH_INFO: `/v3/users/2a7015c0b9ac43db99f2f126f304e065` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:06.607184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f996d-1257-4640-b212-bb5720830e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7015c0b9ac43db99f2f126f304e065)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:06.608985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f996d-1257-4640-b212-bb5720830e2d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:06.644178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9c891-5b9e-4b97-90f7-44e975bad9dc service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:06.646196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7ce9c891-5b9e-4b97-90f7-44e975bad9dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:06.678899 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9c891-5b9e-4b97-90f7-44e975bad9dc service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:06.685640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:06.686875 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:06.687313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:06.687713 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b admin admin] PATH_INFO: `/v3/projects/edf6d87ad29a40dfbc05046422d53977` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:06.689057 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf6d87ad29a40dfbc05046422d53977)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:06.691250 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:06.912500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf6d87ad29a40dfbc05046422d53977', 'request_id': 'req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:06.926416 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d85f996d-1257-4640-b212-bb5720830e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7015c0b9ac43db99f2f126f304e065'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:06.927083 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d85f996d-1257-4640-b212-bb5720830e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7015c0b9ac43db99f2f126f304e065'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:06.927738 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d85f996d-1257-4640-b212-bb5720830e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7015c0b9ac43db99f2f126f304e065'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:07.015526 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf6d87ad29a40dfbc05046422d53977', 'request_id': 'req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:07.021318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf6d87ad29a40dfbc05046422d53977', 'request_id': 'req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:07.032633 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b admin admin] The token cache is being invalidate because project edf6d87ad29a40dfbc05046422d53977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:07.032846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:07.033485 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-a45fb884-dc00-4f65-8a8e-941bcaf42c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:07.035198 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 914/1842] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:06 2021] DELETE /identity/v3/projects/edf6d87ad29a40dfbc05046422d53977 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:07.040809 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1a38a-0694-4b57-a344-da2406bab5a7 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:07.041949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1a38a-0694-4b57-a344-da2406bab5a7 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:07.042202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1a38a-0694-4b57-a344-da2406bab5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:07.064190 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-d2f1a38a-0694-4b57-a344-da2406bab5a7 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:07.065441 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d2f1a38a-0694-4b57-a344-da2406bab5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:07.129995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 915/1843] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:07.138886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e68ea0-d862-41ae-be62-fff1a2b9a56f None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:07.139255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e68ea0-d862-41ae-be62-fff1a2b9a56f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:07.139596 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e68ea0-d862-41ae-be62-fff1a2b9a56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:07.157976 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-03e68ea0-d862-41ae-be62-fff1a2b9a56f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:07.159250 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-03e68ea0-d862-41ae-be62-fff1a2b9a56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:07.164367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d85f996d-1257-4640-b212-bb5720830e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7015c0b9ac43db99f2f126f304e065'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:07.172409 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 916/1844] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:07.177628 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e68ea0-d862-41ae-be62-fff1a2b9a56f None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:07.195294 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d85f996d-1257-4640-b212-bb5720830e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7015c0b9ac43db99f2f126f304e065'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:07.198226 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e68ea0-d862-41ae-be62-fff1a2b9a56f None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:07.203623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7219666-da99-4b8c-bd9f-a228d5d815d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:07.204504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7219666-da99-4b8c-bd9f-a228d5d815d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:07.207586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7219666-da99-4b8c-bd9f-a228d5d815d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:07.207586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7219666-da99-4b8c-bd9f-a228d5d815d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:07.207586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7219666-da99-4b8c-bd9f-a228d5d815d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:37:07.207586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7219666-da99-4b8c-bd9f-a228d5d815d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:07.208635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7219666-da99-4b8c-bd9f-a228d5d815d4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:07.214848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 929/1845] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:06 2021] DELETE /identity/v3/users/2a7015c0b9ac43db99f2f126f304e065 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:07.220381 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf26523-523e-4796-ada9-3c19ec459a42 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:07.220969 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf26523-523e-4796-ada9-3c19ec459a42 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:07.221470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf26523-523e-4796-ada9-3c19ec459a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:07.223918 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 917/1846] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:37:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:37:07.228100 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7219666-da99-4b8c-bd9f-a228d5d815d4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:07.241215 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7219666-da99-4b8c-bd9f-a228d5d815d4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:07.247373 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-adf26523-523e-4796-ada9-3c19ec459a42 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:07.248592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-adf26523-523e-4796-ada9-3c19ec459a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:07.307934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabcb5e-18ae-49ee-aefb-dfdac9c4569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:07.308738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabcb5e-18ae-49ee-aefb-dfdac9c4569c admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:07.309034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabcb5e-18ae-49ee-aefb-dfdac9c4569c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:07.309387 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabcb5e-18ae-49ee-aefb-dfdac9c4569c admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:07.310175 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabcb5e-18ae-49ee-aefb-dfdac9c4569c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:07.312202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabcb5e-18ae-49ee-aefb-dfdac9c4569c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:07.315233 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 930/1847] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:07.332235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf26523-523e-4796-ada9-3c19ec459a42 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:07.333878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-adf26523-523e-4796-ada9-3c19ec459a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:07.397412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf26523-523e-4796-ada9-3c19ec459a42 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:07.402957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f73da-956c-48f8-a9e7-574b116dff79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:07.403867 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f73da-956c-48f8-a9e7-574b116dff79 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:07.404152 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f73da-956c-48f8-a9e7-574b116dff79 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:07.404428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f73da-956c-48f8-a9e7-574b116dff79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:07.414367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f73da-956c-48f8-a9e7-574b116dff79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:07.415803 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f73da-956c-48f8-a9e7-574b116dff79 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:07.425148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 931/1848] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:07.446315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 918/1849] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:07 2021] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:37:07.450880 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f73da-956c-48f8-a9e7-574b116dff79 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:07.461543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f73da-956c-48f8-a9e7-574b116dff79 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:07.545496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5bfe5-8af4-48f9-ba69-4522633390f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:07.546523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5bfe5-8af4-48f9-ba69-4522633390f0 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:07.547039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5bfe5-8af4-48f9-ba69-4522633390f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:07.547774 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5bfe5-8af4-48f9-ba69-4522633390f0 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:07.550234 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5bfe5-8af4-48f9-ba69-4522633390f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:07.552451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5bfe5-8af4-48f9-ba69-4522633390f0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:07.581297 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabcb5e-18ae-49ee-aefb-dfdac9c4569c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:07.584641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ccabcb5e-18ae-49ee-aefb-dfdac9c4569c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:07.607445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabcb5e-18ae-49ee-aefb-dfdac9c4569c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:07.611582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:07.612485 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:07.612765 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:07.613040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] PATH_INFO: `/v3/users/bd2b3e43107d4678998b0e898c1fa7c9` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:07.614272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2b3e43107d4678998b0e898c1fa7c9)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:07.616179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:07.683355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 932/1850] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:07 2021] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:07.690599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5bfe5-8af4-48f9-ba69-4522633390f0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:07.702209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5bfe5-8af4-48f9-ba69-4522633390f0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:07.708400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead5728-b6f0-4ad0-b7f4-2b2ed6fe249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:07.708993 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead5728-b6f0-4ad0-b7f4-2b2ed6fe249e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:07.709348 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead5728-b6f0-4ad0-b7f4-2b2ed6fe249e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:07.709694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead5728-b6f0-4ad0-b7f4-2b2ed6fe249e admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:07.711438 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead5728-b6f0-4ad0-b7f4-2b2ed6fe249e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:07.713182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead5728-b6f0-4ad0-b7f4-2b2ed6fe249e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:07.727248 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 933/1851] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:37:07.728768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead5728-b6f0-4ad0-b7f4-2b2ed6fe249e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:07.740732 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead5728-b6f0-4ad0-b7f4-2b2ed6fe249e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:07.751256 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4edf52-71ae-447b-b137-01b6ad3cf884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:07.752057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4edf52-71ae-447b-b137-01b6ad3cf884 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:07.752466 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4edf52-71ae-447b-b137-01b6ad3cf884 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:07.752896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4edf52-71ae-447b-b137-01b6ad3cf884 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:07.753726 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4edf52-71ae-447b-b137-01b6ad3cf884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:07.758124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4edf52-71ae-447b-b137-01b6ad3cf884 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:07.784156 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 934/1852] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:07.785367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4edf52-71ae-447b-b137-01b6ad3cf884 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:07.803627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4edf52-71ae-447b-b137-01b6ad3cf884 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:07.810377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f59321-7126-4f53-a931-07b64b88e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:07.811431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f59321-7126-4f53-a931-07b64b88e31a admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:07.811564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f59321-7126-4f53-a931-07b64b88e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:07.811741 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f59321-7126-4f53-a931-07b64b88e31a admin admin] PATH_INFO: `/v3/projects/12d66496fd584400b4d60a1bca0ea8ac/users/b0df29d84ce74761b55f21d224e97246/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:07.838536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f59321-7126-4f53-a931-07b64b88e31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d66496fd584400b4d60a1bca0ea8ac, user_id=b0df29d84ce74761b55f21d224e97246, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:07.841285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f59321-7126-4f53-a931-07b64b88e31a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:07.859936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2b3e43107d4678998b0e898c1fa7c9'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:07.860844 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2b3e43107d4678998b0e898c1fa7c9'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:07.869531 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2b3e43107d4678998b0e898c1fa7c9'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:07.941019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 935/1853] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:07 2021] PUT /identity/v3/projects/12d66496fd584400b4d60a1bca0ea8ac/users/b0df29d84ce74761b55f21d224e97246/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:07.952909 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9c962-4dc2-472a-a245-f6ee11983246 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:07.953293 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9c962-4dc2-472a-a245-f6ee11983246 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:07.953668 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9c962-4dc2-472a-a245-f6ee11983246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:07.973124 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2b3e43107d4678998b0e898c1fa7c9'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:07.981738 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-21d9c962-4dc2-472a-a245-f6ee11983246 None None] MFA Rules not processed for user `b0df29d84ce74761b55f21d224e97246`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:07.983054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-21d9c962-4dc2-472a-a245-f6ee11983246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:07.993350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2b3e43107d4678998b0e898c1fa7c9'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.010888 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 919/1854] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:07 2021] DELETE /identity/v3/users/bd2b3e43107d4678998b0e898c1fa7c9 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:08.017611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:08.017611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:08.068747 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 936/1855] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:07 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:08.079634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9c962-4dc2-472a-a245-f6ee11983246 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:08.081823 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-21d9c962-4dc2-472a-a245-f6ee11983246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:08.100011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d850ba8-f735-4cfd-a275-80c3466e1207 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:08.109804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:08.111328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:08.111835 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:08.112212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] PATH_INFO: `/v3/projects/905e3ce4475b4d54a3b4ed62f3c31bc9` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:08.113538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=905e3ce4475b4d54a3b4ed62f3c31bc9)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:08.115654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:08.158080 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9c962-4dc2-472a-a245-f6ee11983246 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:08.235127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff90af-091e-424d-b898-86c606d76241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:08.236012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff90af-091e-424d-b898-86c606d76241 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:08.236392 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff90af-091e-424d-b898-86c606d76241 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:08.236769 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff90af-091e-424d-b898-86c606d76241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:08.286193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905e3ce4475b4d54a3b4ed62f3c31bc9', 'request_id': 'req-dd942cfd-6c00-4041-8a4a-122cbd454faf'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.328172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff90af-091e-424d-b898-86c606d76241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:08.329567 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff90af-091e-424d-b898-86c606d76241 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:08.340362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 937/1856] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:08 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:08.447522 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905e3ce4475b4d54a3b4ed62f3c31bc9', 'request_id': 'req-dd942cfd-6c00-4041-8a4a-122cbd454faf'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.454145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905e3ce4475b4d54a3b4ed62f3c31bc9', 'request_id': 'req-dd942cfd-6c00-4041-8a4a-122cbd454faf'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.466684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff90af-091e-424d-b898-86c606d76241 service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:08.466918 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] The token cache is being invalidate because project 905e3ce4475b4d54a3b4ed62f3c31bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:08.467209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.468028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.468763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ceff90af-091e-424d-b898-86c606d76241 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:08.469938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 920/1857] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:08 2021] DELETE /identity/v3/projects/905e3ce4475b4d54a3b4ed62f3c31bc9 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:08.474030 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:08.475536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:08.488457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff90af-091e-424d-b898-86c606d76241 service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:08.563431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:08.564486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:08.564813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:08.565664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] PATH_INFO: `/v3/projects/27f2b6ca8e714503a38d20c10983ad79` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:08.567265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f2b6ca8e714503a38d20c10983ad79)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:08.569179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:08.569692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd942cfd-6c00-4041-8a4a-122cbd454faf admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:08.575052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd14dc8-623a-48ca-b1a2-2ab39a3a63ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:08.579614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd14dc8-623a-48ca-b1a2-2ab39a3a63ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:08.579614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd14dc8-623a-48ca-b1a2-2ab39a3a63ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:08.579614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd14dc8-623a-48ca-b1a2-2ab39a3a63ba admin admin] PATH_INFO: `/v3/users/891afc29e03345ae85f399706c1f51de` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:08.579614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd14dc8-623a-48ca-b1a2-2ab39a3a63ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=891afc29e03345ae85f399706c1f51de)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:08.580971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd14dc8-623a-48ca-b1a2-2ab39a3a63ba admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:08.792168 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f2b6ca8e714503a38d20c10983ad79', 'request_id': 'req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.792343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6fd14dc8-623a-48ca-b1a2-2ab39a3a63ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891afc29e03345ae85f399706c1f51de'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.792823 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6fd14dc8-623a-48ca-b1a2-2ab39a3a63ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891afc29e03345ae85f399706c1f51de'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.799991 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6fd14dc8-623a-48ca-b1a2-2ab39a3a63ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891afc29e03345ae85f399706c1f51de'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.904339 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f2b6ca8e714503a38d20c10983ad79', 'request_id': 'req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.910993 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f2b6ca8e714503a38d20c10983ad79', 'request_id': 'req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.922791 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] The token cache is being invalidate because project 27f2b6ca8e714503a38d20c10983ad79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:08.923191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.923722 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:08.925356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 938/1858] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:08 2021] DELETE /identity/v3/projects/27f2b6ca8e714503a38d20c10983ad79 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:08.931175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:08.931175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:08.992334 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6fd14dc8-623a-48ca-b1a2-2ab39a3a63ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891afc29e03345ae85f399706c1f51de'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:09.006320 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6fd14dc8-623a-48ca-b1a2-2ab39a3a63ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891afc29e03345ae85f399706c1f51de'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:09.012144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d4388-6a3a-4a7e-8064-dd4f3301ea7a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:09.017318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 921/1859] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:08 2021] DELETE /identity/v3/users/891afc29e03345ae85f399706c1f51de => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:09.017318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a5fe6-83be-49f6-a5d0-bfb95470ce26 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.017318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a5fe6-83be-49f6-a5d0-bfb95470ce26 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.017318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a5fe6-83be-49f6-a5d0-bfb95470ce26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.046028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-fe4a5fe6-83be-49f6-a5d0-bfb95470ce26 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:09.047597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-fe4a5fe6-83be-49f6-a5d0-bfb95470ce26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:09.075159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03e17f-a0c4-48e8-8b14-846224641419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:09.076050 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03e17f-a0c4-48e8-8b14-846224641419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.076328 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03e17f-a0c4-48e8-8b14-846224641419 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.076598 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03e17f-a0c4-48e8-8b14-846224641419 admin admin] PATH_INFO: `/v3/users/89d534b74bb74771b85cf05215c8849b` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.077883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03e17f-a0c4-48e8-8b14-846224641419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d534b74bb74771b85cf05215c8849b)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:09.079847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03e17f-a0c4-48e8-8b14-846224641419 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:09.119818 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 922/1860] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:09.129312 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935262ee-9f04-4c2e-9363-07769b9d95b3 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.129610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935262ee-9f04-4c2e-9363-07769b9d95b3 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.129916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935262ee-9f04-4c2e-9363-07769b9d95b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.156413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-935262ee-9f04-4c2e-9363-07769b9d95b3 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:09.158504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-935262ee-9f04-4c2e-9363-07769b9d95b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:09.174405 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 923/1861] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:09.175053 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935262ee-9f04-4c2e-9363-07769b9d95b3 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:09.188006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935262ee-9f04-4c2e-9363-07769b9d95b3 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:09.193512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9e0e4-c6a6-4e8e-b7b5-83120652cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:09.194223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9e0e4-c6a6-4e8e-b7b5-83120652cdce admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.194555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9e0e4-c6a6-4e8e-b7b5-83120652cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.194833 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9e0e4-c6a6-4e8e-b7b5-83120652cdce admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.195896 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9e0e4-c6a6-4e8e-b7b5-83120652cdce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:37:09.196201 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9e0e4-c6a6-4e8e-b7b5-83120652cdce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:09.197882 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9e0e4-c6a6-4e8e-b7b5-83120652cdce admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:09.211313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 924/1862] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:37:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:37:09.215718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9e0e4-c6a6-4e8e-b7b5-83120652cdce admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:09.231411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9e0e4-c6a6-4e8e-b7b5-83120652cdce admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:09.236471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db99aa9-b162-4ed1-b78d-0c5609efc43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:09.237144 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db99aa9-b162-4ed1-b78d-0c5609efc43f admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.237453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db99aa9-b162-4ed1-b78d-0c5609efc43f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.237726 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db99aa9-b162-4ed1-b78d-0c5609efc43f admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.238501 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db99aa9-b162-4ed1-b78d-0c5609efc43f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:09.240492 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db99aa9-b162-4ed1-b78d-0c5609efc43f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:09.300446 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3a03e17f-a0c4-48e8-8b14-846224641419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d534b74bb74771b85cf05215c8849b'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:09.301416 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3a03e17f-a0c4-48e8-8b14-846224641419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d534b74bb74771b85cf05215c8849b'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:09.302163 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3a03e17f-a0c4-48e8-8b14-846224641419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d534b74bb74771b85cf05215c8849b'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:09.355389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 925/1863] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:09 2021] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:37:09.359432 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db99aa9-b162-4ed1-b78d-0c5609efc43f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:09.361087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0db99aa9-b162-4ed1-b78d-0c5609efc43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:09.380182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3a03e17f-a0c4-48e8-8b14-846224641419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d534b74bb74771b85cf05215c8849b'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:09.401455 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3a03e17f-a0c4-48e8-8b14-846224641419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d534b74bb74771b85cf05215c8849b'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:09.420734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 939/1864] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:08 2021] DELETE /identity/v3/users/89d534b74bb74771b85cf05215c8849b => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:09.438282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db99aa9-b162-4ed1-b78d-0c5609efc43f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:09.444211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f228f-6499-4bb1-8a61-eed73ac147dc None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.447517 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f228f-6499-4bb1-8a61-eed73ac147dc None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.447804 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f228f-6499-4bb1-8a61-eed73ac147dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.485784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-5a4f228f-6499-4bb1-8a61-eed73ac147dc None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:09.490676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5a4f228f-6499-4bb1-8a61-eed73ac147dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:09.538945 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e09bb-8657-4458-ad3f-dcca08d537ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:09.540392 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e09bb-8657-4458-ad3f-dcca08d537ab admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.540907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e09bb-8657-4458-ad3f-dcca08d537ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.541273 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e09bb-8657-4458-ad3f-dcca08d537ab admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.542087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e09bb-8657-4458-ad3f-dcca08d537ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:09.544637 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e09bb-8657-4458-ad3f-dcca08d537ab admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:09.587133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 940/1865] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:09.587920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f228f-6499-4bb1-8a61-eed73ac147dc None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:09.589299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5a4f228f-6499-4bb1-8a61-eed73ac147dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:09.605817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f228f-6499-4bb1-8a61-eed73ac147dc None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:09.614984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:09.615849 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.616127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.616971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01 admin admin] PATH_INFO: `/v3/projects/4e4dfd7e01614873a106ca2ea4683361` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.618291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4dfd7e01614873a106ca2ea4683361)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:09.620185 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:09.657240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 926/1866] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:09 2021] POST /identity/v3/users => generated 294 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:37:09.658453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e09bb-8657-4458-ad3f-dcca08d537ab admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:09.660140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ff6e09bb-8657-4458-ad3f-dcca08d537ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:09.740062 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e09bb-8657-4458-ad3f-dcca08d537ab admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:09.744764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4dfd7e01614873a106ca2ea4683361', 'request_id': 'req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:09.782792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398ac0e-b673-4efb-93d4-c89555faf95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:09.783450 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398ac0e-b673-4efb-93d4-c89555faf95b service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.783734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398ac0e-b673-4efb-93d4-c89555faf95b service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.784003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398ac0e-b673-4efb-93d4-c89555faf95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.843586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398ac0e-b673-4efb-93d4-c89555faf95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:09.845037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398ac0e-b673-4efb-93d4-c89555faf95b service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:09.855511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4dfd7e01614873a106ca2ea4683361', 'request_id': 'req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:09.860084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 927/1867] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:09.860084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398ac0e-b673-4efb-93d4-c89555faf95b service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:09.861826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4dfd7e01614873a106ca2ea4683361', 'request_id': 'req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:09.868103 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398ac0e-b673-4efb-93d4-c89555faf95b service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:09.872232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d390e92-43e6-4ebd-93ce-464f7bd482a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:09.872906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d390e92-43e6-4ebd-93ce-464f7bd482a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.873184 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d390e92-43e6-4ebd-93ce-464f7bd482a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.873463 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d390e92-43e6-4ebd-93ce-464f7bd482a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.874216 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d390e92-43e6-4ebd-93ce-464f7bd482a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:09.875808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d390e92-43e6-4ebd-93ce-464f7bd482a9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:09.882275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01 admin admin] The token cache is being invalidate because project 4e4dfd7e01614873a106ca2ea4683361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:09.882605 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:09.890833 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3c8ec6b2-6416-4e95-b87b-ae9451ac3d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:09.891101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 928/1868] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:09.891181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 941/1869] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:09 2021] DELETE /identity/v3/projects/4e4dfd7e01614873a106ca2ea4683361 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:09.893712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d390e92-43e6-4ebd-93ce-464f7bd482a9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:09.894217 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894530d-f7dd-4438-81c7-00341441d632 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.894448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894530d-f7dd-4438-81c7-00341441d632 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.894851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894530d-f7dd-4438-81c7-00341441d632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.895643 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8d390e92-43e6-4ebd-93ce-464f7bd482a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:09.908622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d390e92-43e6-4ebd-93ce-464f7bd482a9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:09.914698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584cadf-aa7d-4678-8d78-5596ef53ed1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:09.915439 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584cadf-aa7d-4678-8d78-5596ef53ed1e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.916306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584cadf-aa7d-4678-8d78-5596ef53ed1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.916306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584cadf-aa7d-4678-8d78-5596ef53ed1e admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.916880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584cadf-aa7d-4678-8d78-5596ef53ed1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:09.918583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584cadf-aa7d-4678-8d78-5596ef53ed1e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:09.927415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-6894530d-f7dd-4438-81c7-00341441d632 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:09.934357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-6894530d-f7dd-4438-81c7-00341441d632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:09.943720 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 929/1870] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:09 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:09.945008 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584cadf-aa7d-4678-8d78-5596ef53ed1e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:09.951185 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 942/1871] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:09.959052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584cadf-aa7d-4678-8d78-5596ef53ed1e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:09.959424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a6ba4-a761-4690-b0cf-75f634ebc58a None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.959715 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a6ba4-a761-4690-b0cf-75f634ebc58a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.960635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a6ba4-a761-4690-b0cf-75f634ebc58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.967776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3938384-8b0c-4f82-ba65-f5d0ebf62205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:09.968028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3938384-8b0c-4f82-ba65-f5d0ebf62205 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:09.968871 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3938384-8b0c-4f82-ba65-f5d0ebf62205 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:09.968871 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3938384-8b0c-4f82-ba65-f5d0ebf62205 admin admin] PATH_INFO: `/v3/projects/adbff648dfc04114bebdfbf823d01198/users/8c7d710a9e3e4debbf7b0cbb90780507/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:09.984311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-571a6ba4-a761-4690-b0cf-75f634ebc58a None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:09.986477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-571a6ba4-a761-4690-b0cf-75f634ebc58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:09.987318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3938384-8b0c-4f82-ba65-f5d0ebf62205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbff648dfc04114bebdfbf823d01198, user_id=8c7d710a9e3e4debbf7b0cbb90780507, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:09.990422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3938384-8b0c-4f82-ba65-f5d0ebf62205 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:10.004537 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 943/1872] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:10.006148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a6ba4-a761-4690-b0cf-75f634ebc58a None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:10.016112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a6ba4-a761-4690-b0cf-75f634ebc58a None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:10.020783 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab262fe-f1ef-4b71-8b7d-d8b868b73f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:10.021448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab262fe-f1ef-4b71-8b7d-d8b868b73f5d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.021728 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab262fe-f1ef-4b71-8b7d-d8b868b73f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.022029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab262fe-f1ef-4b71-8b7d-d8b868b73f5d admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.023397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab262fe-f1ef-4b71-8b7d-d8b868b73f5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:37:10.023955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab262fe-f1ef-4b71-8b7d-d8b868b73f5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:10.025550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab262fe-f1ef-4b71-8b7d-d8b868b73f5d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:10.037145 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 944/1873] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:37:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:37:10.042209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab262fe-f1ef-4b71-8b7d-d8b868b73f5d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:10.052809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab262fe-f1ef-4b71-8b7d-d8b868b73f5d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:10.058058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac814f7f-32f6-43e0-9c84-717115d406cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:10.058728 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac814f7f-32f6-43e0-9c84-717115d406cb admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.059008 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac814f7f-32f6-43e0-9c84-717115d406cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.059282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac814f7f-32f6-43e0-9c84-717115d406cb admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.059967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac814f7f-32f6-43e0-9c84-717115d406cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:10.061984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac814f7f-32f6-43e0-9c84-717115d406cb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:10.081816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 930/1874] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:09 2021] PUT /identity/v3/projects/adbff648dfc04114bebdfbf823d01198/users/8c7d710a9e3e4debbf7b0cbb90780507/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:10.128204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d36be0-d994-451f-a4ac-01fcb06ebad7 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.128452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d36be0-d994-451f-a4ac-01fcb06ebad7 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.128693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d36be0-d994-451f-a4ac-01fcb06ebad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.205199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 945/1875] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:10 2021] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:37:10.208766 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac814f7f-32f6-43e0-9c84-717115d406cb admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:10.213347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-83d36be0-d994-451f-a4ac-01fcb06ebad7 None None] MFA Rules not processed for user `8c7d710a9e3e4debbf7b0cbb90780507`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:10.214878 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-83d36be0-d994-451f-a4ac-01fcb06ebad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:10.279211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac814f7f-32f6-43e0-9c84-717115d406cb admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:10.284141 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061fddf-50a6-4dee-8f4d-50003985cfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:10.284821 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061fddf-50a6-4dee-8f4d-50003985cfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.285228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061fddf-50a6-4dee-8f4d-50003985cfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.285408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061fddf-50a6-4dee-8f4d-50003985cfa9 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.286302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061fddf-50a6-4dee-8f4d-50003985cfa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:10.288945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061fddf-50a6-4dee-8f4d-50003985cfa9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:10.290574 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 931/1876] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:10 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:10.295011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d36be0-d994-451f-a4ac-01fcb06ebad7 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:10.305758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d36be0-d994-451f-a4ac-01fcb06ebad7 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:10.310500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519db12c-de65-45aa-966f-a09ada135ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:10.311093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519db12c-de65-45aa-966f-a09ada135ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.311515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519db12c-de65-45aa-966f-a09ada135ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.318359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519db12c-de65-45aa-966f-a09ada135ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.318359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519db12c-de65-45aa-966f-a09ada135ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:10.318359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519db12c-de65-45aa-966f-a09ada135ae9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:10.390626 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 946/1877] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:10 2021] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:10.394131 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061fddf-50a6-4dee-8f4d-50003985cfa9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:10.406345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061fddf-50a6-4dee-8f4d-50003985cfa9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:10.411253 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4c353-ed5d-4c80-a0df-cf05703157af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:10.411863 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4c353-ed5d-4c80-a0df-cf05703157af admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.412149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4c353-ed5d-4c80-a0df-cf05703157af admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.412429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4c353-ed5d-4c80-a0df-cf05703157af admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.413155 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4c353-ed5d-4c80-a0df-cf05703157af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:10.415509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4c353-ed5d-4c80-a0df-cf05703157af admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:10.425753 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 947/1878] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:10 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:37:10.430007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4c353-ed5d-4c80-a0df-cf05703157af admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:10.437650 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 932/1879] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:10 2021] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:10.440322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4c353-ed5d-4c80-a0df-cf05703157af admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:10.441618 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519db12c-de65-45aa-966f-a09ada135ae9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:10.505842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b70df-4f80-42c6-8be0-e33015e1fd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:10.507521 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b70df-4f80-42c6-8be0-e33015e1fd1e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.507944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b70df-4f80-42c6-8be0-e33015e1fd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.508373 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b70df-4f80-42c6-8be0-e33015e1fd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.509373 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b70df-4f80-42c6-8be0-e33015e1fd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:10.511752 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b70df-4f80-42c6-8be0-e33015e1fd1e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:10.533690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 948/1880] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:10 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:10.534680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b70df-4f80-42c6-8be0-e33015e1fd1e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:10.536697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e17b70df-4f80-42c6-8be0-e33015e1fd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:10.540296 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519db12c-de65-45aa-966f-a09ada135ae9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:10.545557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a05c4-6739-4388-bd7f-8528e09aee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:10.546318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a05c4-6739-4388-bd7f-8528e09aee00 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.546587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a05c4-6739-4388-bd7f-8528e09aee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.546862 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a05c4-6739-4388-bd7f-8528e09aee00 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.550638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a05c4-6739-4388-bd7f-8528e09aee00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:10.554568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a05c4-6739-4388-bd7f-8528e09aee00 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:10.561597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b70df-4f80-42c6-8be0-e33015e1fd1e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:10.566985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:10.568475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.568475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.568836 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] PATH_INFO: `/v3/projects/06d476d68e724afb9afec16d885b8d5f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.571045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d476d68e724afb9afec16d885b8d5f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:10.573486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:10.639733 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 933/1881] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:10 2021] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:37:10.643911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a05c4-6739-4388-bd7f-8528e09aee00 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:10.655583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a05c4-6739-4388-bd7f-8528e09aee00 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:10.660329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa4b2d-d774-4e11-8e80-03b76918775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:10.661219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa4b2d-d774-4e11-8e80-03b76918775c admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.665984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa4b2d-d774-4e11-8e80-03b76918775c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.665984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa4b2d-d774-4e11-8e80-03b76918775c admin admin] PATH_INFO: `/v3/projects/cac34f17a8184bf1980689177742745e/users/8ee4ea5854a045ad9c4adef6756b819e/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.677235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa4b2d-d774-4e11-8e80-03b76918775c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac34f17a8184bf1980689177742745e, user_id=8ee4ea5854a045ad9c4adef6756b819e, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:10.680430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa4b2d-d774-4e11-8e80-03b76918775c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:10.758747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 934/1882] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:10 2021] PUT /identity/v3/projects/cac34f17a8184bf1980689177742745e/users/8ee4ea5854a045ad9c4adef6756b819e/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:10.765348 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa4b2d-d774-4e11-8e80-03b76918775c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:10.782828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d476d68e724afb9afec16d885b8d5f', 'request_id': 'req-97415dc8-d452-4c05-ad01-aef06651e32a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:10.842287 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa4b2d-d774-4e11-8e80-03b76918775c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:10.847044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d476d68e724afb9afec16d885b8d5f', 'request_id': 'req-97415dc8-d452-4c05-ad01-aef06651e32a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:10.847240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab596d15-1786-47cc-a46c-8f2716a66b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:10.847901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596d15-1786-47cc-a46c-8f2716a66b51 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.848185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596d15-1786-47cc-a46c-8f2716a66b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.848723 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596d15-1786-47cc-a46c-8f2716a66b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.849533 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab596d15-1786-47cc-a46c-8f2716a66b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:10.851824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab596d15-1786-47cc-a46c-8f2716a66b51 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:10.855058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d476d68e724afb9afec16d885b8d5f', 'request_id': 'req-97415dc8-d452-4c05-ad01-aef06651e32a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:10.868641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 935/1883] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:10 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:10.871477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] The token cache is being invalidate because project 06d476d68e724afb9afec16d885b8d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:10.873004 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:10.873210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a477a-d63b-4bc8-8553-29b9589a81ff None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.873491 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a477a-d63b-4bc8-8553-29b9589a81ff None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.877974 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:10.878115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a477a-d63b-4bc8-8553-29b9589a81ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.879814 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 949/1884] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:10 2021] DELETE /identity/v3/projects/06d476d68e724afb9afec16d885b8d5f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:10.880643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:10.884811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:10.909424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c28a477a-d63b-4bc8-8553-29b9589a81ff None None] MFA Rules not processed for user `8ee4ea5854a045ad9c4adef6756b819e`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:10.910668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c28a477a-d63b-4bc8-8553-29b9589a81ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:10.968755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97415dc8-d452-4c05-ad01-aef06651e32a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:10.973756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c591f-ffc1-45de-9f71-7b2697d51a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:10.974708 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c591f-ffc1-45de-9f71-7b2697d51a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.974992 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c591f-ffc1-45de-9f71-7b2697d51a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.975259 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c591f-ffc1-45de-9f71-7b2697d51a86 admin admin] PATH_INFO: `/v3/projects/7eb0b3697fae4f0ca69a547a19d02122/users/7e074ca706bf47288a9dd76027957035/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:10.976407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 936/1885] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:10 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:10.976407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a477a-d63b-4bc8-8553-29b9589a81ff None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:10.976407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c28a477a-d63b-4bc8-8553-29b9589a81ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:10.991729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c591f-ffc1-45de-9f71-7b2697d51a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb0b3697fae4f0ca69a547a19d02122, user_id=7e074ca706bf47288a9dd76027957035, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:10.993004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a477a-d63b-4bc8-8553-29b9589a81ff None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:10.994582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c591f-ffc1-45de-9f71-7b2697d51a86 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:10.997763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b2f0f-be6f-4ad9-af62-bbcf58c1f2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:10.998654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b2f0f-be6f-4ad9-af62-bbcf58c1f2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:10.998937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b2f0f-be6f-4ad9-af62-bbcf58c1f2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:10.999211 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b2f0f-be6f-4ad9-af62-bbcf58c1f2fe admin admin] PATH_INFO: `/v3/users/e258a59e4db4494a9af0979116c80c38` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:11.000390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b2f0f-be6f-4ad9-af62-bbcf58c1f2fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e258a59e4db4494a9af0979116c80c38)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:11.002375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b2f0f-be6f-4ad9-af62-bbcf58c1f2fe admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:11.087507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 950/1886] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:10 2021] PUT /identity/v3/projects/7eb0b3697fae4f0ca69a547a19d02122/users/7e074ca706bf47288a9dd76027957035/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:11.088565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c591f-ffc1-45de-9f71-7b2697d51a86 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:11.090235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c83c591f-ffc1-45de-9f71-7b2697d51a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:11.151627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c591f-ffc1-45de-9f71-7b2697d51a86 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:11.156391 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b414c-3ae6-40ae-8be0-07403a658fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:11.157042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b414c-3ae6-40ae-8be0-07403a658fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:11.157323 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b414c-3ae6-40ae-8be0-07403a658fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:11.157597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b414c-3ae6-40ae-8be0-07403a658fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:11.158303 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b414c-3ae6-40ae-8be0-07403a658fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:11.160276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b414c-3ae6-40ae-8be0-07403a658fe4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:11.268929 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 951/1887] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:11 2021] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:11.270104 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b414c-3ae6-40ae-8be0-07403a658fe4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:11.333409 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b414c-3ae6-40ae-8be0-07403a658fe4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:11.339296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f9e14-3df2-4a93-ab91-871cd41a466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:11.339445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f9e14-3df2-4a93-ab91-871cd41a466f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:11.339748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f9e14-3df2-4a93-ab91-871cd41a466f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:11.340038 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f9e14-3df2-4a93-ab91-871cd41a466f admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:11.340906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f9e14-3df2-4a93-ab91-871cd41a466f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:11.342530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f9e14-3df2-4a93-ab91-871cd41a466f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:11.354332 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 952/1888] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:11 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:11.355371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f9e14-3df2-4a93-ab91-871cd41a466f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:11.364895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f9e14-3df2-4a93-ab91-871cd41a466f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:11.371298 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23a49c-03c7-4832-9477-870692c662b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:11.371969 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23a49c-03c7-4832-9477-870692c662b9 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:11.372242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23a49c-03c7-4832-9477-870692c662b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:11.372522 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23a49c-03c7-4832-9477-870692c662b9 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:11.373240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23a49c-03c7-4832-9477-870692c662b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:11.375211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23a49c-03c7-4832-9477-870692c662b9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:11.383018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-cc0b2f0f-be6f-4ad9-af62-bbcf58c1f2fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e258a59e4db4494a9af0979116c80c38'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:11.383904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-cc0b2f0f-be6f-4ad9-af62-bbcf58c1f2fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e258a59e4db4494a9af0979116c80c38'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:11.390948 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-cc0b2f0f-be6f-4ad9-af62-bbcf58c1f2fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e258a59e4db4494a9af0979116c80c38'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:11.477195 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 953/1889] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:11 2021] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:11.477950 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23a49c-03c7-4832-9477-870692c662b9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:11.489675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23a49c-03c7-4832-9477-870692c662b9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:11.494605 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2bb54-e142-4122-b431-ecaf2f1a939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:11.495482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2bb54-e142-4122-b431-ecaf2f1a939c admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:11.495758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2bb54-e142-4122-b431-ecaf2f1a939c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:11.496029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2bb54-e142-4122-b431-ecaf2f1a939c admin admin] PATH_INFO: `/v3/projects/7eb0b3697fae4f0ca69a547a19d02122/users/7e074ca706bf47288a9dd76027957035/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:11.498027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2bb54-e142-4122-b431-ecaf2f1a939c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb0b3697fae4f0ca69a547a19d02122, user_id=7e074ca706bf47288a9dd76027957035, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:11.498750 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-cc0b2f0f-be6f-4ad9-af62-bbcf58c1f2fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e258a59e4db4494a9af0979116c80c38'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:11.500636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2bb54-e142-4122-b431-ecaf2f1a939c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:11.512247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 954/1890] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:11 2021] PUT /identity/v3/projects/7eb0b3697fae4f0ca69a547a19d02122/users/7e074ca706bf47288a9dd76027957035/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:11.512469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-cc0b2f0f-be6f-4ad9-af62-bbcf58c1f2fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e258a59e4db4494a9af0979116c80c38'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:11.512883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2bb54-e142-4122-b431-ecaf2f1a939c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:11.519928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 937/1891] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:10 2021] DELETE /identity/v3/users/e258a59e4db4494a9af0979116c80c38 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:11.526982 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5d3db-3b39-4e65-a290-54ec70d0325e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:11.527271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5d3db-3b39-4e65-a290-54ec70d0325e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:11.527547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5d3db-3b39-4e65-a290-54ec70d0325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:11.559121 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-a6b5d3db-3b39-4e65-a290-54ec70d0325e None None] MFA Rules not processed for user `7e074ca706bf47288a9dd76027957035`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:11.560515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a6b5d3db-3b39-4e65-a290-54ec70d0325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:11.578496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2bb54-e142-4122-b431-ecaf2f1a939c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:11.637170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 938/1892] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:11 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:11.644190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898334f-f94a-4905-8027-24846143eaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:11.644866 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898334f-f94a-4905-8027-24846143eaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:11.645144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898334f-f94a-4905-8027-24846143eaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:11.645451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898334f-f94a-4905-8027-24846143eaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:11.646209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898334f-f94a-4905-8027-24846143eaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:11.648496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898334f-f94a-4905-8027-24846143eaf2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:11.655793 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5d3db-3b39-4e65-a290-54ec70d0325e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:11.657271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a6b5d3db-3b39-4e65-a290-54ec70d0325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:11.659708 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 955/1893] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:11 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:11.664119 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898334f-f94a-4905-8027-24846143eaf2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:11.666173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2898334f-f94a-4905-8027-24846143eaf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:11.681590 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898334f-f94a-4905-8027-24846143eaf2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:11.691076 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d370a-bcec-4b7f-bef3-9dbfe2e77f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:11.692126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d370a-bcec-4b7f-bef3-9dbfe2e77f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:11.692491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d370a-bcec-4b7f-bef3-9dbfe2e77f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:11.692777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d370a-bcec-4b7f-bef3-9dbfe2e77f1d admin admin] PATH_INFO: `/v3/projects/cfdb10ed7a8e4e96969d6b54ab76cf2e/users/2019310526de490398a87246f914a66f/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:11.711964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d370a-bcec-4b7f-bef3-9dbfe2e77f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb10ed7a8e4e96969d6b54ab76cf2e, user_id=2019310526de490398a87246f914a66f, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:11.715798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d370a-bcec-4b7f-bef3-9dbfe2e77f1d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:11.727173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5d3db-3b39-4e65-a290-54ec70d0325e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:11.731847 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ddc0b-0876-4ea0-844e-5d5c76ee097b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:11.732555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ddc0b-0876-4ea0-844e-5d5c76ee097b service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:11.732844 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ddc0b-0876-4ea0-844e-5d5c76ee097b service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:11.733505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ddc0b-0876-4ea0-844e-5d5c76ee097b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:11.746006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ddc0b-0876-4ea0-844e-5d5c76ee097b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:11.747686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ddc0b-0876-4ea0-844e-5d5c76ee097b service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:11.759241 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 939/1894] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:11 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:11.810723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 956/1895] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:11 2021] PUT /identity/v3/projects/cfdb10ed7a8e4e96969d6b54ab76cf2e/users/2019310526de490398a87246f914a66f/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:11.814695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ddc0b-0876-4ea0-844e-5d5c76ee097b service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:11.845574 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ddc0b-0876-4ea0-844e-5d5c76ee097b service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:11.856458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d370a-bcec-4b7f-bef3-9dbfe2e77f1d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:11.858746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4a6d370a-bcec-4b7f-bef3-9dbfe2e77f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:11.946640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26a6c-4050-4874-a0c9-68be2e713ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:11.947583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26a6c-4050-4874-a0c9-68be2e713ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:11.947869 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26a6c-4050-4874-a0c9-68be2e713ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:11.948155 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26a6c-4050-4874-a0c9-68be2e713ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:11.948915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26a6c-4050-4874-a0c9-68be2e713ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:11.949590 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d370a-bcec-4b7f-bef3-9dbfe2e77f1d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:11.953984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26a6c-4050-4874-a0c9-68be2e713ef5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:11.965952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:11.971634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:11.971634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:11.971634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] PATH_INFO: `/v3/users/8c7d710a9e3e4debbf7b0cbb90780507` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:11.971634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7d710a9e3e4debbf7b0cbb90780507)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:11.971946 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 940/1896] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:11 2021] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:11.972383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26a6c-4050-4874-a0c9-68be2e713ef5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:11.972652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:11.990740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e8c26a6c-4050-4874-a0c9-68be2e713ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:12.014632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26a6c-4050-4874-a0c9-68be2e713ef5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:12.020123 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:12.020993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:12.021271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:12.021547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] PATH_INFO: `/v3/projects/1fe951b0e4ca45b9b1a2e06a0d2da727` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:12.023530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe951b0e4ca45b9b1a2e06a0d2da727)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:12.025564 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:12.280498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe951b0e4ca45b9b1a2e06a0d2da727', 'request_id': 'req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.281535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7d710a9e3e4debbf7b0cbb90780507'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.282204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7d710a9e3e4debbf7b0cbb90780507'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.282856 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7d710a9e3e4debbf7b0cbb90780507'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.323208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe951b0e4ca45b9b1a2e06a0d2da727', 'request_id': 'req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.328794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe951b0e4ca45b9b1a2e06a0d2da727', 'request_id': 'req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.340922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] The token cache is being invalidate because project 1fe951b0e4ca45b9b1a2e06a0d2da727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:12.341213 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.341851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.343397 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 941/1897] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:11 2021] DELETE /identity/v3/projects/1fe951b0e4ca45b9b1a2e06a0d2da727 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:12.346286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:12.346286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:12.374866 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7d710a9e3e4debbf7b0cbb90780507'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.387942 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7d710a9e3e4debbf7b0cbb90780507'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.400155 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 957/1898] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:11 2021] DELETE /identity/v3/users/8c7d710a9e3e4debbf7b0cbb90780507 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:12.401208 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:12.402528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:12.410327 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6bbbf-4fc6-4b05-8f85-98a0a136b0dd admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:12.463220 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b3ce8-3365-499b-bdbf-fbfec71604f8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:12.464275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1af30b-e9b5-463a-848d-5fb66b656cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:12.465168 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af30b-e9b5-463a-848d-5fb66b656cda admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:12.465447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af30b-e9b5-463a-848d-5fb66b656cda admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:12.465723 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af30b-e9b5-463a-848d-5fb66b656cda admin admin] PATH_INFO: `/v3/projects/cfdb10ed7a8e4e96969d6b54ab76cf2e/users/2019310526de490398a87246f914a66f/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:12.467764 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1af30b-e9b5-463a-848d-5fb66b656cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb10ed7a8e4e96969d6b54ab76cf2e, user_id=2019310526de490398a87246f914a66f, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:12.467962 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:12.468639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:12.468920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:12.469193 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] PATH_INFO: `/v3/users/2e36601074d64400aa0b804e745ef813` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:12.470430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1af30b-e9b5-463a-848d-5fb66b656cda admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:12.470549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e36601074d64400aa0b804e745ef813)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:12.472395 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:12.480724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 942/1899] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:12 2021] PUT /identity/v3/projects/cfdb10ed7a8e4e96969d6b54ab76cf2e/users/2019310526de490398a87246f914a66f/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:12.481996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d372-6750-47e4-b72e-e402ff2d604d None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:12.482286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d372-6750-47e4-b72e-e402ff2d604d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:12.482569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d372-6750-47e4-b72e-e402ff2d604d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:12.506422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0a30d372-6750-47e4-b72e-e402ff2d604d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:12.508195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0a30d372-6750-47e4-b72e-e402ff2d604d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:12.564148 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 943/1900] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:12.565350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68dfb-7734-4e57-a5cd-40b07a3770c3 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:12.565636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68dfb-7734-4e57-a5cd-40b07a3770c3 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:12.565942 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68dfb-7734-4e57-a5cd-40b07a3770c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:12.592005 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-54f68dfb-7734-4e57-a5cd-40b07a3770c3 None None] MFA Rules not processed for user `2019310526de490398a87246f914a66f`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:12.593206 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-54f68dfb-7734-4e57-a5cd-40b07a3770c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:12.659497 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 944/1901] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:12 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:12.660490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68dfb-7734-4e57-a5cd-40b07a3770c3 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:12.661744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-54f68dfb-7734-4e57-a5cd-40b07a3770c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:12.667792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e36601074d64400aa0b804e745ef813'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.668769 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e36601074d64400aa0b804e745ef813'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.669501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e36601074d64400aa0b804e745ef813'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.717972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68dfb-7734-4e57-a5cd-40b07a3770c3 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:12.721654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1dbc1-45cf-4b40-bfbf-198a2ef8ef21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:12.722334 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1dbc1-45cf-4b40-bfbf-198a2ef8ef21 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:12.722616 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1dbc1-45cf-4b40-bfbf-198a2ef8ef21 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:12.722888 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1dbc1-45cf-4b40-bfbf-198a2ef8ef21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:12.724969 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d5d1dbc1-45cf-4b40-bfbf-198a2ef8ef21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:12.737626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1dbc1-45cf-4b40-bfbf-198a2ef8ef21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:12.738309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e36601074d64400aa0b804e745ef813'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.739092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1dbc1-45cf-4b40-bfbf-198a2ef8ef21 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:12.749504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 945/1902] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:12.750334 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1dbc1-45cf-4b40-bfbf-198a2ef8ef21 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:12.751351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e36601074d64400aa0b804e745ef813'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:12.751624 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d5d1dbc1-45cf-4b40-bfbf-198a2ef8ef21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:12.764310 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 958/1903] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:12 2021] DELETE /identity/v3/users/2e36601074d64400aa0b804e745ef813 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:12.766498 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:12.767304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:12.809079 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1dbc1-45cf-4b40-bfbf-198a2ef8ef21 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:12.833722 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50355e81-0e3b-4777-a56e-ef9a150e7798 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:12.838862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8c005-5f19-4b15-85e8-7c885f63ed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:12.839755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8c005-5f19-4b15-85e8-7c885f63ed18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:12.840208 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8c005-5f19-4b15-85e8-7c885f63ed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:12.840581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8c005-5f19-4b15-85e8-7c885f63ed18 admin admin] PATH_INFO: `/v3/users/b0df29d84ce74761b55f21d224e97246` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:12.841962 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8c005-5f19-4b15-85e8-7c885f63ed18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0df29d84ce74761b55f21d224e97246)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:12.844106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8c005-5f19-4b15-85e8-7c885f63ed18 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:12.864552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f0f4f-d301-4727-9613-a31a3dbd089c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:12.865263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0f4f-d301-4727-9613-a31a3dbd089c service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:12.865675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0f4f-d301-4727-9613-a31a3dbd089c service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:12.866027 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0f4f-d301-4727-9613-a31a3dbd089c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:12.868662 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0e2f0f4f-d301-4727-9613-a31a3dbd089c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:12.931478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f0f4f-d301-4727-9613-a31a3dbd089c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:12.932938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f0f4f-d301-4727-9613-a31a3dbd089c service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:12.942606 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 946/1904] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:12 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:12.971153 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f0f4f-d301-4727-9613-a31a3dbd089c service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:12.972255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0e2f0f4f-d301-4727-9613-a31a3dbd089c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:12.986105 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f0f4f-d301-4727-9613-a31a3dbd089c service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:12.990871 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:12.991810 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:12.992089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:12.992359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] PATH_INFO: `/v3/users/8ee4ea5854a045ad9c4adef6756b819e` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:12.993556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee4ea5854a045ad9c4adef6756b819e)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:12.995501 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:13.038804 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fca8c005-5f19-4b15-85e8-7c885f63ed18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0df29d84ce74761b55f21d224e97246'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.040211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fca8c005-5f19-4b15-85e8-7c885f63ed18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0df29d84ce74761b55f21d224e97246'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.040990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fca8c005-5f19-4b15-85e8-7c885f63ed18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0df29d84ce74761b55f21d224e97246'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.167636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fca8c005-5f19-4b15-85e8-7c885f63ed18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0df29d84ce74761b55f21d224e97246'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.184094 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fca8c005-5f19-4b15-85e8-7c885f63ed18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0df29d84ce74761b55f21d224e97246'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.204878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 959/1905] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:12 2021] DELETE /identity/v3/users/b0df29d84ce74761b55f21d224e97246 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:13.209508 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a02604-77e4-47c5-a936-e96fe8366bb8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:13.210854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a02604-77e4-47c5-a936-e96fe8366bb8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:13.211467 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a02604-77e4-47c5-a936-e96fe8366bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:13.243223 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b7a02604-77e4-47c5-a936-e96fe8366bb8 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:13.244788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b7a02604-77e4-47c5-a936-e96fe8366bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:13.251612 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee4ea5854a045ad9c4adef6756b819e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.252620 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee4ea5854a045ad9c4adef6756b819e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.261681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee4ea5854a045ad9c4adef6756b819e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.322246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 960/1906] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:13.336743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a02604-77e4-47c5-a936-e96fe8366bb8 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:13.338516 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b7a02604-77e4-47c5-a936-e96fe8366bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:13.359904 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a02604-77e4-47c5-a936-e96fe8366bb8 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:13.361286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee4ea5854a045ad9c4adef6756b819e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.378808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:13.378808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:13.378808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:13.378808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] PATH_INFO: `/v3/projects/adbff648dfc04114bebdfbf823d01198` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:13.379214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbff648dfc04114bebdfbf823d01198)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:13.380876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:13.383267 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee4ea5854a045ad9c4adef6756b819e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.389781 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 947/1907] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:12 2021] DELETE /identity/v3/users/8ee4ea5854a045ad9c4adef6756b819e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:13.390713 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:13.393372 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:13.450673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2546673-db4e-448b-a0bd-610f65b3eddd admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:13.454271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ec350-31a9-4dba-a744-2770e2eb6517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:13.454926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ec350-31a9-4dba-a744-2770e2eb6517 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:13.455209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ec350-31a9-4dba-a744-2770e2eb6517 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:13.455484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ec350-31a9-4dba-a744-2770e2eb6517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:13.457226 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ff9ec350-31a9-4dba-a744-2770e2eb6517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:13.489016 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbff648dfc04114bebdfbf823d01198', 'request_id': 'req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.520015 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ec350-31a9-4dba-a744-2770e2eb6517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:13.521440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ec350-31a9-4dba-a744-2770e2eb6517 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:13.535760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 948/1908] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:13.535760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5471-91a2-43ac-b397-6f081025e9a0 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:13.535760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5471-91a2-43ac-b397-6f081025e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:13.535760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5471-91a2-43ac-b397-6f081025e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:13.553264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e5aa5471-91a2-43ac-b397-6f081025e9a0 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:13.554760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e5aa5471-91a2-43ac-b397-6f081025e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:13.555491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbff648dfc04114bebdfbf823d01198', 'request_id': 'req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.561680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbff648dfc04114bebdfbf823d01198', 'request_id': 'req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.573889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] The token cache is being invalidate because project adbff648dfc04114bebdfbf823d01198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:13.574479 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.575162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.576944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 961/1909] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:13 2021] DELETE /identity/v3/projects/adbff648dfc04114bebdfbf823d01198 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:13.577784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:13.579114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:13.623469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 949/1910] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:13.623469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa5471-91a2-43ac-b397-6f081025e9a0 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:13.626254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e5aa5471-91a2-43ac-b397-6f081025e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:13.638632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa5471-91a2-43ac-b397-6f081025e9a0 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:13.643253 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ca866-f8e1-4141-9ab4-80bd83a891dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:13.644126 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ca866-f8e1-4141-9ab4-80bd83a891dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:13.644408 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ca866-f8e1-4141-9ab4-80bd83a891dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:13.644688 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ca866-f8e1-4141-9ab4-80bd83a891dd admin admin] PATH_INFO: `/v3/users/7e074ca706bf47288a9dd76027957035` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:13.645957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ca866-f8e1-4141-9ab4-80bd83a891dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e074ca706bf47288a9dd76027957035)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:13.648663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ca866-f8e1-4141-9ab4-80bd83a891dd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:13.653470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0cc47-0628-4994-b2f2-c8baca9b9eab admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:13.658361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:13.659248 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:13.659536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:13.659812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] PATH_INFO: `/v3/projects/7eef5742f042495385deda0a6dfa71f0` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:13.661000 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eef5742f042495385deda0a6dfa71f0)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:13.662977 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:13.834928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eef5742f042495385deda0a6dfa71f0', 'request_id': 'req-3102575a-6009-4a2c-992d-aded56ed154f'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.836176 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-7b9ca866-f8e1-4141-9ab4-80bd83a891dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e074ca706bf47288a9dd76027957035'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.836881 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-7b9ca866-f8e1-4141-9ab4-80bd83a891dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e074ca706bf47288a9dd76027957035'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.844367 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-7b9ca866-f8e1-4141-9ab4-80bd83a891dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e074ca706bf47288a9dd76027957035'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.906607 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eef5742f042495385deda0a6dfa71f0', 'request_id': 'req-3102575a-6009-4a2c-992d-aded56ed154f'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.912214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eef5742f042495385deda0a6dfa71f0', 'request_id': 'req-3102575a-6009-4a2c-992d-aded56ed154f'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.922809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] The token cache is being invalidate because project 7eef5742f042495385deda0a6dfa71f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:13.923077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.923711 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.925250 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 962/1911] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:13 2021] DELETE /identity/v3/projects/7eef5742f042495385deda0a6dfa71f0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:13.926037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:13.927286 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:13.969228 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-7b9ca866-f8e1-4141-9ab4-80bd83a891dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e074ca706bf47288a9dd76027957035'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.982658 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-7b9ca866-f8e1-4141-9ab4-80bd83a891dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e074ca706bf47288a9dd76027957035'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:13.986194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102575a-6009-4a2c-992d-aded56ed154f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:13.988745 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 950/1912] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:13 2021] DELETE /identity/v3/users/7e074ca706bf47288a9dd76027957035 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:13.990101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0b819-ad1c-4ef2-8b8d-ff799933a8f9 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:13.990343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0b819-ad1c-4ef2-8b8d-ff799933a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:13.990529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39100a12-ffb2-482e-8584-b197b1456768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:13.990681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0b819-ad1c-4ef2-8b8d-ff799933a8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:13.991874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39100a12-ffb2-482e-8584-b197b1456768 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:13.992238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39100a12-ffb2-482e-8584-b197b1456768 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:13.992515 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39100a12-ffb2-482e-8584-b197b1456768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:13.994404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-39100a12-ffb2-482e-8584-b197b1456768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:14.015187 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-28f0b819-ad1c-4ef2-8b8d-ff799933a8f9 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:14.016410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-28f0b819-ad1c-4ef2-8b8d-ff799933a8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:14.067818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39100a12-ffb2-482e-8584-b197b1456768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:14.070056 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39100a12-ffb2-482e-8584-b197b1456768 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:14.080677 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 963/1913] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:14.081354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39100a12-ffb2-482e-8584-b197b1456768 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:14.082939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-39100a12-ffb2-482e-8584-b197b1456768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:14.087801 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 951/1914] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:14.095785 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39100a12-ffb2-482e-8584-b197b1456768 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:14.097028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ed085-aa6e-488b-8248-789e591f0945 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.097522 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ed085-aa6e-488b-8248-789e591f0945 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.098132 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ed085-aa6e-488b-8248-789e591f0945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.103249 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fc414-68fd-45f3-b1ca-837452d3b523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:14.104451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fc414-68fd-45f3-b1ca-837452d3b523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.104806 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fc414-68fd-45f3-b1ca-837452d3b523 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.105158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fc414-68fd-45f3-b1ca-837452d3b523 admin admin] PATH_INFO: `/v3/projects/12d66496fd584400b4d60a1bca0ea8ac` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.106530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fc414-68fd-45f3-b1ca-837452d3b523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d66496fd584400b4d60a1bca0ea8ac)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:14.108644 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fc414-68fd-45f3-b1ca-837452d3b523 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:14.122100 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0b1ed085-aa6e-488b-8248-789e591f0945 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:14.123532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0b1ed085-aa6e-488b-8248-789e591f0945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:14.131965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 952/1915] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:14.135884 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ed085-aa6e-488b-8248-789e591f0945 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:14.144741 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ed085-aa6e-488b-8248-789e591f0945 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:14.149638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bb765-0d74-497a-8186-7b0e02eeb9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:14.150332 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bb765-0d74-497a-8186-7b0e02eeb9bc admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.150689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bb765-0d74-497a-8186-7b0e02eeb9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.150957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bb765-0d74-497a-8186-7b0e02eeb9bc admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.151719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bb765-0d74-497a-8186-7b0e02eeb9bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:37:14.152019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bb765-0d74-497a-8186-7b0e02eeb9bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:14.153624 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bb765-0d74-497a-8186-7b0e02eeb9bc admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:14.165452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 953/1916] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:37:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:37:14.169489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bb765-0d74-497a-8186-7b0e02eeb9bc admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:14.180038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bb765-0d74-497a-8186-7b0e02eeb9bc admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:14.184573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e176a6-9719-4d2e-8fc7-e018d572c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:14.185255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e176a6-9719-4d2e-8fc7-e018d572c798 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.185529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e176a6-9719-4d2e-8fc7-e018d572c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.187133 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e176a6-9719-4d2e-8fc7-e018d572c798 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.187133 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e176a6-9719-4d2e-8fc7-e018d572c798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:14.188374 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e176a6-9719-4d2e-8fc7-e018d572c798 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:14.227139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ef1fc414-68fd-45f3-b1ca-837452d3b523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d66496fd584400b4d60a1bca0ea8ac', 'request_id': 'req-ef1fc414-68fd-45f3-b1ca-837452d3b523'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:14.293792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 954/1917] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:14 2021] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:37:14.295640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e176a6-9719-4d2e-8fc7-e018d572c798 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:14.350856 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ef1fc414-68fd-45f3-b1ca-837452d3b523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d66496fd584400b4d60a1bca0ea8ac', 'request_id': 'req-ef1fc414-68fd-45f3-b1ca-837452d3b523'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:14.357828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ef1fc414-68fd-45f3-b1ca-837452d3b523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d66496fd584400b4d60a1bca0ea8ac', 'request_id': 'req-ef1fc414-68fd-45f3-b1ca-837452d3b523'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:14.371539 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ef1fc414-68fd-45f3-b1ca-837452d3b523 admin admin] The token cache is being invalidate because project 12d66496fd584400b4d60a1bca0ea8ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:14.372097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ef1fc414-68fd-45f3-b1ca-837452d3b523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:14.372940 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ef1fc414-68fd-45f3-b1ca-837452d3b523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:14.379154 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 964/1918] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:14 2021] DELETE /identity/v3/projects/12d66496fd584400b4d60a1bca0ea8ac => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:14.381320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd08d-1b40-406d-b9a4-6c2622afa18b None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.381638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd08d-1b40-406d-b9a4-6c2622afa18b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.381933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd08d-1b40-406d-b9a4-6c2622afa18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.390831 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e176a6-9719-4d2e-8fc7-e018d572c798 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:14.396800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8328769-1eef-435f-93b3-c27a6c2bceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:14.397725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8328769-1eef-435f-93b3-c27a6c2bceca admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.398109 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8328769-1eef-435f-93b3-c27a6c2bceca admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.398458 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8328769-1eef-435f-93b3-c27a6c2bceca admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.399271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8328769-1eef-435f-93b3-c27a6c2bceca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:14.402290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8328769-1eef-435f-93b3-c27a6c2bceca admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:14.403782 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d2dcd08d-1b40-406d-b9a4-6c2622afa18b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:14.405022 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d2dcd08d-1b40-406d-b9a4-6c2622afa18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:14.415202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 965/1919] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:14.422770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ff09c-8e27-4011-8d8a-869460cb9734 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.423054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ff09c-8e27-4011-8d8a-869460cb9734 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.423265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ff09c-8e27-4011-8d8a-869460cb9734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.450381 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-316ff09c-8e27-4011-8d8a-869460cb9734 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:14.451593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-316ff09c-8e27-4011-8d8a-869460cb9734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:14.460835 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 966/1920] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:14.468533 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ff09c-8e27-4011-8d8a-869460cb9734 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:14.479564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ff09c-8e27-4011-8d8a-869460cb9734 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:14.484327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dce84-0c0c-4275-9506-b0b344b1c2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:14.484992 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dce84-0c0c-4275-9506-b0b344b1c2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.485403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dce84-0c0c-4275-9506-b0b344b1c2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.485684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dce84-0c0c-4275-9506-b0b344b1c2c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.486447 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dce84-0c0c-4275-9506-b0b344b1c2c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:37:14.486755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dce84-0c0c-4275-9506-b0b344b1c2c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:14.488399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dce84-0c0c-4275-9506-b0b344b1c2c8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:14.501908 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 967/1921] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:37:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:37:14.505193 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dce84-0c0c-4275-9506-b0b344b1c2c8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:14.520034 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dce84-0c0c-4275-9506-b0b344b1c2c8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:14.534870 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a183d3-2ae4-4ab8-ab00-4cae23d31e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:14.534870 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a183d3-2ae4-4ab8-ab00-4cae23d31e15 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.534870 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a183d3-2ae4-4ab8-ab00-4cae23d31e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.534870 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a183d3-2ae4-4ab8-ab00-4cae23d31e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.535347 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a183d3-2ae4-4ab8-ab00-4cae23d31e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:14.538480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a183d3-2ae4-4ab8-ab00-4cae23d31e15 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:14.538622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 955/1922] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:14 2021] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:14.538622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8328769-1eef-435f-93b3-c27a6c2bceca admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:14.549614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b8328769-1eef-435f-93b3-c27a6c2bceca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:14.571798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8328769-1eef-435f-93b3-c27a6c2bceca admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:14.577335 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:14.579808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.580292 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.581184 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] PATH_INFO: `/v3/projects/7eb0b3697fae4f0ca69a547a19d02122` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.582544 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb0b3697fae4f0ca69a547a19d02122)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:14.587188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:14.634247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 968/1923] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:14 2021] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:37:14.634247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a183d3-2ae4-4ab8-ab00-4cae23d31e15 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:14.634247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-26a183d3-2ae4-4ab8-ab00-4cae23d31e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:14.694777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a183d3-2ae4-4ab8-ab00-4cae23d31e15 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:14.699472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c07c88-01f2-42b4-b064-a08d5a7be28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:14.700160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07c88-01f2-42b4-b064-a08d5a7be28b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.700422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07c88-01f2-42b4-b064-a08d5a7be28b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.700694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c07c88-01f2-42b4-b064-a08d5a7be28b admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.701420 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c07c88-01f2-42b4-b064-a08d5a7be28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:14.703235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c07c88-01f2-42b4-b064-a08d5a7be28b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:14.713484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 969/1924] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:14 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:14.714295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c07c88-01f2-42b4-b064-a08d5a7be28b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:14.719141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb0b3697fae4f0ca69a547a19d02122', 'request_id': 'req-82dfd1f8-0982-43f5-8df4-d839597818fd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:14.727704 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c07c88-01f2-42b4-b064-a08d5a7be28b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:14.786071 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6219e9-c3f3-428f-aadf-e732b364d684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:14.786754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6219e9-c3f3-428f-aadf-e732b364d684 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.787039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6219e9-c3f3-428f-aadf-e732b364d684 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.787337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6219e9-c3f3-428f-aadf-e732b364d684 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.789078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6219e9-c3f3-428f-aadf-e732b364d684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:14.791185 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6219e9-c3f3-428f-aadf-e732b364d684 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:14.838055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb0b3697fae4f0ca69a547a19d02122', 'request_id': 'req-82dfd1f8-0982-43f5-8df4-d839597818fd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:14.844026 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb0b3697fae4f0ca69a547a19d02122', 'request_id': 'req-82dfd1f8-0982-43f5-8df4-d839597818fd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:14.856560 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] The token cache is being invalidate because project 7eb0b3697fae4f0ca69a547a19d02122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:14.856846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:14.857509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:14.859130 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 956/1925] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:14 2021] DELETE /identity/v3/projects/7eb0b3697fae4f0ca69a547a19d02122 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:14.859891 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:14.861146 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:14.873161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfd1f8-0982-43f5-8df4-d839597818fd admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:14.877738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115a35b-0eb2-4f8e-bee8-c64ec75bc3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:14.878412 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115a35b-0eb2-4f8e-bee8-c64ec75bc3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.878693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115a35b-0eb2-4f8e-bee8-c64ec75bc3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.883293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115a35b-0eb2-4f8e-bee8-c64ec75bc3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.883293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115a35b-0eb2-4f8e-bee8-c64ec75bc3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:14.883293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115a35b-0eb2-4f8e-bee8-c64ec75bc3f4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:14.891657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 957/1926] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:14.892468 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115a35b-0eb2-4f8e-bee8-c64ec75bc3f4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:14.894433 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5115a35b-0eb2-4f8e-bee8-c64ec75bc3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:14.907047 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115a35b-0eb2-4f8e-bee8-c64ec75bc3f4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:14.911678 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:14.912502 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.912811 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.913087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892 admin admin] PATH_INFO: `/v3/projects/cac34f17a8184bf1980689177742745e` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.914284 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac34f17a8184bf1980689177742745e)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:14.916142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:14.945665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 970/1927] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:14 2021] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:14.947095 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8f50c-860c-4203-8303-c8b1a3c835b8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.947456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8f50c-860c-4203-8303-c8b1a3c835b8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.947810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8f50c-860c-4203-8303-c8b1a3c835b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:14.969685 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d4e8f50c-860c-4203-8303-c8b1a3c835b8 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:14.970945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d4e8f50c-860c-4203-8303-c8b1a3c835b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:14.980101 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 971/1928] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:14.980674 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8f50c-860c-4203-8303-c8b1a3c835b8 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:14.990291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8f50c-860c-4203-8303-c8b1a3c835b8 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:14.995095 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51615bd-82d7-4f94-ba24-0b254e1c060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:14.998003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51615bd-82d7-4f94-ba24-0b254e1c060d admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:14.998003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51615bd-82d7-4f94-ba24-0b254e1c060d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:14.998003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51615bd-82d7-4f94-ba24-0b254e1c060d admin admin] PATH_INFO: `/v3/projects/6a97f12e335d4a568bf45bb1bdcd27e7/users/ad898ee517a24512a3fdedf74bb988f6/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:15.012401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51615bd-82d7-4f94-ba24-0b254e1c060d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a97f12e335d4a568bf45bb1bdcd27e7, user_id=ad898ee517a24512a3fdedf74bb988f6, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:15.015250 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51615bd-82d7-4f94-ba24-0b254e1c060d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:15.033048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac34f17a8184bf1980689177742745e', 'request_id': 'req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:15.123925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 972/1929] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:14 2021] PUT /identity/v3/projects/6a97f12e335d4a568bf45bb1bdcd27e7/users/ad898ee517a24512a3fdedf74bb988f6/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:15.124764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51615bd-82d7-4f94-ba24-0b254e1c060d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:15.126342 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f51615bd-82d7-4f94-ba24-0b254e1c060d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:15.128970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac34f17a8184bf1980689177742745e', 'request_id': 'req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:15.136652 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac34f17a8184bf1980689177742745e', 'request_id': 'req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:15.148820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892 admin admin] The token cache is being invalidate because project cac34f17a8184bf1980689177742745e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:15.149101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:15.149781 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e5c0541b-5ab8-48e0-a46a-e6c5a0658892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:15.151402 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 958/1930] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:14 2021] DELETE /identity/v3/projects/cac34f17a8184bf1980689177742745e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:15.152772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2063884-3652-45d4-8f08-a95c1be689fe None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:15.153062 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2063884-3652-45d4-8f08-a95c1be689fe None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:15.153333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2063884-3652-45d4-8f08-a95c1be689fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:15.171592 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f2063884-3652-45d4-8f08-a95c1be689fe None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:15.175859 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f2063884-3652-45d4-8f08-a95c1be689fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:15.188834 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51615bd-82d7-4f94-ba24-0b254e1c060d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:15.193507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d81c7b-7564-4cbe-b66d-ac90eccfb0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:15.195443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d81c7b-7564-4cbe-b66d-ac90eccfb0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:15.195778 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d81c7b-7564-4cbe-b66d-ac90eccfb0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:15.196000 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d81c7b-7564-4cbe-b66d-ac90eccfb0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:15.196712 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d81c7b-7564-4cbe-b66d-ac90eccfb0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:15.198360 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d81c7b-7564-4cbe-b66d-ac90eccfb0d3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:15.210528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 973/1931] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:15 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:15.210528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bda23-f29d-4a90-bae3-9086a29cf2f7 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:15.210823 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bda23-f29d-4a90-bae3-9086a29cf2f7 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:15.210918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bda23-f29d-4a90-bae3-9086a29cf2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:15.237932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 959/1932] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:15.238865 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2063884-3652-45d4-8f08-a95c1be689fe None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:15.239867 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-df5bda23-f29d-4a90-bae3-9086a29cf2f7 None None] MFA Rules not processed for user `ad898ee517a24512a3fdedf74bb988f6`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:15.240158 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f2063884-3652-45d4-8f08-a95c1be689fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:15.242340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-df5bda23-f29d-4a90-bae3-9086a29cf2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:15.252494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2063884-3652-45d4-8f08-a95c1be689fe None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:15.258112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:15.258993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:15.259273 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:15.259568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] PATH_INFO: `/v3/users/2019310526de490398a87246f914a66f` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:15.260760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2019310526de490398a87246f914a66f)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:15.262723 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:15.313592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 974/1933] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:15 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:15.314469 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bda23-f29d-4a90-bae3-9086a29cf2f7 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:15.315706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-df5bda23-f29d-4a90-bae3-9086a29cf2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:15.328981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bda23-f29d-4a90-bae3-9086a29cf2f7 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:15.333616 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebc13b-acb6-4425-9c09-89941526c8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:15.334313 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc13b-acb6-4425-9c09-89941526c8de admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:15.334665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc13b-acb6-4425-9c09-89941526c8de admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:15.334932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc13b-acb6-4425-9c09-89941526c8de admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:15.335648 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebc13b-acb6-4425-9c09-89941526c8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:15.337218 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebc13b-acb6-4425-9c09-89941526c8de admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:15.346955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 975/1934] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:15 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:15.347727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebc13b-acb6-4425-9c09-89941526c8de admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:15.357175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebc13b-acb6-4425-9c09-89941526c8de admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:15.361783 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f541f-e0a9-4f9a-82c4-932404694ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:15.362473 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f541f-e0a9-4f9a-82c4-932404694ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:15.362754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f541f-e0a9-4f9a-82c4-932404694ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:15.363031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f541f-e0a9-4f9a-82c4-932404694ab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:15.363723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f541f-e0a9-4f9a-82c4-932404694ab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:37:15.364050 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f541f-e0a9-4f9a-82c4-932404694ab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:15.365598 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f541f-e0a9-4f9a-82c4-932404694ab8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:15.377383 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 976/1935] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:37:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:37:15.378150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f541f-e0a9-4f9a-82c4-932404694ab8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:15.379738 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1a9f541f-e0a9-4f9a-82c4-932404694ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:15.393008 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f541f-e0a9-4f9a-82c4-932404694ab8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:15.397964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a70bf-531e-4996-8660-71672f91ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:15.398581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a70bf-531e-4996-8660-71672f91ff5c admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:15.398860 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a70bf-531e-4996-8660-71672f91ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:15.399129 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a70bf-531e-4996-8660-71672f91ff5c admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:15.399793 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a70bf-531e-4996-8660-71672f91ff5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:15.401627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a70bf-531e-4996-8660-71672f91ff5c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:15.460966 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2019310526de490398a87246f914a66f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:15.461629 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2019310526de490398a87246f914a66f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:15.468358 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2019310526de490398a87246f914a66f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:15.511436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 977/1936] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:15 2021] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:15.511436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a70bf-531e-4996-8660-71672f91ff5c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:15.517947 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2019310526de490398a87246f914a66f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:15.530930 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2019310526de490398a87246f914a66f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:15.538427 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 960/1937] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:15 2021] DELETE /identity/v3/users/2019310526de490398a87246f914a66f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:15.539329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:15.540742 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:15.608645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a70bf-531e-4996-8660-71672f91ff5c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:15.681074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893566-407c-4821-bd62-c1e6351d544f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:15.692130 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38260756-e844-44a0-a6ef-864343a18302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:15.697718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38260756-e844-44a0-a6ef-864343a18302 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:15.699526 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38260756-e844-44a0-a6ef-864343a18302 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:15.699812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38260756-e844-44a0-a6ef-864343a18302 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:15.700566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38260756-e844-44a0-a6ef-864343a18302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:15.703613 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38260756-e844-44a0-a6ef-864343a18302 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:15.733970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc5c29-ae61-4f27-a898-b9bebcec5960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:15.735244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc5c29-ae61-4f27-a898-b9bebcec5960 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:15.735789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc5c29-ae61-4f27-a898-b9bebcec5960 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:15.736660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc5c29-ae61-4f27-a898-b9bebcec5960 admin admin] PATH_INFO: `/v3/projects/0dd75f7e4d024fc0904348990b9e3863/users/5720a71e2a5a4332be8bdc32036515e8/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:15.751510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc5c29-ae61-4f27-a898-b9bebcec5960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd75f7e4d024fc0904348990b9e3863, user_id=5720a71e2a5a4332be8bdc32036515e8, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:15.754369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc5c29-ae61-4f27-a898-b9bebcec5960 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:15.851792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 961/1938] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:15 2021] POST /identity/v3/projects => generated 387 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:15.851792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38260756-e844-44a0-a6ef-864343a18302 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:15.852058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 978/1939] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:15 2021] PUT /identity/v3/projects/0dd75f7e4d024fc0904348990b9e3863/users/5720a71e2a5a4332be8bdc32036515e8/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:15.852942 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc5c29-ae61-4f27-a898-b9bebcec5960 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:15.857421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-38260756-e844-44a0-a6ef-864343a18302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:15.927073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc5c29-ae61-4f27-a898-b9bebcec5960 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:15.928086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38260756-e844-44a0-a6ef-864343a18302 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:15.932724 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bb0fe-ba6a-44eb-86dc-2698dd78ac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:15.933524 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bb0fe-ba6a-44eb-86dc-2698dd78ac67 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:15.933955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bb0fe-ba6a-44eb-86dc-2698dd78ac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:15.934635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bb0fe-ba6a-44eb-86dc-2698dd78ac67 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:15.935093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a44f4c-3a27-44cb-9759-af907e76736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:15.935366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bb0fe-ba6a-44eb-86dc-2698dd78ac67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:15.937432 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bb0fe-ba6a-44eb-86dc-2698dd78ac67 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:15.938307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a44f4c-3a27-44cb-9759-af907e76736f admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:15.938592 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a44f4c-3a27-44cb-9759-af907e76736f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:15.938873 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a44f4c-3a27-44cb-9759-af907e76736f admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:15.939567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a44f4c-3a27-44cb-9759-af907e76736f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:15.941530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a44f4c-3a27-44cb-9759-af907e76736f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:16.039543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 979/1940] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:15 2021] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:16.039543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa27ad-65c4-49e9-88d2-e5efd4acde3c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.039543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa27ad-65c4-49e9-88d2-e5efd4acde3c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.039543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa27ad-65c4-49e9-88d2-e5efd4acde3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.063673 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-58fa27ad-65c4-49e9-88d2-e5efd4acde3c None None] MFA Rules not processed for user `5720a71e2a5a4332be8bdc32036515e8`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:16.064892 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-58fa27ad-65c4-49e9-88d2-e5efd4acde3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:16.098681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 962/1941] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:15 2021] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:16.099827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a44f4c-3a27-44cb-9759-af907e76736f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:16.110181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a44f4c-3a27-44cb-9759-af907e76736f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:16.114888 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a57987-e2b9-46d6-ac7a-2362b41cc947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:16.115551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a57987-e2b9-46d6-ac7a-2362b41cc947 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.116385 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a57987-e2b9-46d6-ac7a-2362b41cc947 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.116718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a57987-e2b9-46d6-ac7a-2362b41cc947 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.117530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a57987-e2b9-46d6-ac7a-2362b41cc947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:16.119138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a57987-e2b9-46d6-ac7a-2362b41cc947 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:16.129718 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 980/1942] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:16 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:16.129848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 963/1943] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:16 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:16.129980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa27ad-65c4-49e9-88d2-e5efd4acde3c None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:16.134496 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a57987-e2b9-46d6-ac7a-2362b41cc947 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:16.137034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d4a57987-e2b9-46d6-ac7a-2362b41cc947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:16.141742 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa27ad-65c4-49e9-88d2-e5efd4acde3c None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:16.146936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142bc64-272d-480f-9073-86eda6a0988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:16.147695 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142bc64-272d-480f-9073-86eda6a0988c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.147976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142bc64-272d-480f-9073-86eda6a0988c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.148248 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142bc64-272d-480f-9073-86eda6a0988c admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.148971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142bc64-272d-480f-9073-86eda6a0988c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:16.150627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142bc64-272d-480f-9073-86eda6a0988c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:16.158784 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a57987-e2b9-46d6-ac7a-2362b41cc947 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:16.164904 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 981/1944] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:16 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:16.164904 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142bc64-272d-480f-9073-86eda6a0988c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:16.166593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b392e-9c48-415c-b7bf-34a5e8bff405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:16.167459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b392e-9c48-415c-b7bf-34a5e8bff405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.167744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b392e-9c48-415c-b7bf-34a5e8bff405 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.168016 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b392e-9c48-415c-b7bf-34a5e8bff405 admin admin] PATH_INFO: `/v3/projects/cfdb10ed7a8e4e96969d6b54ab76cf2e` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.169190 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b392e-9c48-415c-b7bf-34a5e8bff405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfdb10ed7a8e4e96969d6b54ab76cf2e)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:16.171181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b392e-9c48-415c-b7bf-34a5e8bff405 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:16.174283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142bc64-272d-480f-9073-86eda6a0988c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:16.179773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1364310-e82f-4f80-96e4-1b253cf78a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:16.180419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1364310-e82f-4f80-96e4-1b253cf78a8a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.180703 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1364310-e82f-4f80-96e4-1b253cf78a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.180976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1364310-e82f-4f80-96e4-1b253cf78a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.181691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1364310-e82f-4f80-96e4-1b253cf78a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:16.183289 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1364310-e82f-4f80-96e4-1b253cf78a8a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:16.193115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 982/1945] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:16.194636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1364310-e82f-4f80-96e4-1b253cf78a8a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:16.198374 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b1364310-e82f-4f80-96e4-1b253cf78a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:16.251996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1364310-e82f-4f80-96e4-1b253cf78a8a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:16.255640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603c06c-69cf-4164-a581-42a2daff35dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db83070471e34df695b571cdab440b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:16.256270 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603c06c-69cf-4164-a581-42a2daff35dd service glance] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.257228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603c06c-69cf-4164-a581-42a2daff35dd service glance] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.257610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603c06c-69cf-4164-a581-42a2daff35dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.265601 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603c06c-69cf-4164-a581-42a2daff35dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:16.267051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603c06c-69cf-4164-a581-42a2daff35dd service glance] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:16.275411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 983/1946] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:16 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:16.276172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603c06c-69cf-4164-a581-42a2daff35dd service glance] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:16.285629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603c06c-69cf-4164-a581-42a2daff35dd service glance] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:16.290301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aec5f7-5aa2-41d4-b900-a77f6b21c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:16.290874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aec5f7-5aa2-41d4-b900-a77f6b21c76d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.291149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aec5f7-5aa2-41d4-b900-a77f6b21c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.291419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aec5f7-5aa2-41d4-b900-a77f6b21c76d admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.292113 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aec5f7-5aa2-41d4-b900-a77f6b21c76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:16.293639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aec5f7-5aa2-41d4-b900-a77f6b21c76d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:16.305422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 984/1947] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:16 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:16.305422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aec5f7-5aa2-41d4-b900-a77f6b21c76d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:16.314989 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aec5f7-5aa2-41d4-b900-a77f6b21c76d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:16.320465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289e5c8-a457-410b-b5a7-5f72a8f2eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:16.321322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289e5c8-a457-410b-b5a7-5f72a8f2eed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.321604 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289e5c8-a457-410b-b5a7-5f72a8f2eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.321920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289e5c8-a457-410b-b5a7-5f72a8f2eed8 admin admin] PATH_INFO: `/v3/projects/f2d3d1e43396411dadb69f841befc55f/users/d43f9aa80ebd42b4be370ac51f9d8d18/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.336936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289e5c8-a457-410b-b5a7-5f72a8f2eed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d3d1e43396411dadb69f841befc55f, user_id=d43f9aa80ebd42b4be370ac51f9d8d18, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:16.339723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289e5c8-a457-410b-b5a7-5f72a8f2eed8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:16.461646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 985/1948] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:16 2021] PUT /identity/v3/projects/f2d3d1e43396411dadb69f841befc55f/users/d43f9aa80ebd42b4be370ac51f9d8d18/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:16.462373 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289e5c8-a457-410b-b5a7-5f72a8f2eed8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:16.482498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-250b392e-9c48-415c-b7bf-34a5e8bff405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfdb10ed7a8e4e96969d6b54ab76cf2e', 'request_id': 'req-250b392e-9c48-415c-b7bf-34a5e8bff405'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:16.527753 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289e5c8-a457-410b-b5a7-5f72a8f2eed8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:16.569244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-250b392e-9c48-415c-b7bf-34a5e8bff405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfdb10ed7a8e4e96969d6b54ab76cf2e', 'request_id': 'req-250b392e-9c48-415c-b7bf-34a5e8bff405'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:16.575706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-250b392e-9c48-415c-b7bf-34a5e8bff405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfdb10ed7a8e4e96969d6b54ab76cf2e', 'request_id': 'req-250b392e-9c48-415c-b7bf-34a5e8bff405'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:16.584408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a08518-7d33-432b-bd48-6817c2aad8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:16.585615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a08518-7d33-432b-bd48-6817c2aad8d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.585911 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a08518-7d33-432b-bd48-6817c2aad8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.586187 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a08518-7d33-432b-bd48-6817c2aad8d8 admin admin] PATH_INFO: `/v3/projects/331efd622a2746b892acb85e67417e33/users/483eb959772c450fbad6f7130377c90b/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.587534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-250b392e-9c48-415c-b7bf-34a5e8bff405 admin admin] The token cache is being invalidate because project cfdb10ed7a8e4e96969d6b54ab76cf2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:16.587826 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-250b392e-9c48-415c-b7bf-34a5e8bff405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:16.588462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-250b392e-9c48-415c-b7bf-34a5e8bff405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:16.590020 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 964/1949] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:16 2021] DELETE /identity/v3/projects/cfdb10ed7a8e4e96969d6b54ab76cf2e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:16.591403 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa91e1-fd38-455c-822f-e5556eb3b9bf None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.591696 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa91e1-fd38-455c-822f-e5556eb3b9bf None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.591984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa91e1-fd38-455c-822f-e5556eb3b9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.602330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a08518-7d33-432b-bd48-6817c2aad8d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=331efd622a2746b892acb85e67417e33, user_id=483eb959772c450fbad6f7130377c90b, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:16.604982 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a08518-7d33-432b-bd48-6817c2aad8d8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:16.619551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-dcfa91e1-fd38-455c-822f-e5556eb3b9bf None None] MFA Rules not processed for user `d43f9aa80ebd42b4be370ac51f9d8d18`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:16.620790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-dcfa91e1-fd38-455c-822f-e5556eb3b9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:16.688903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 965/1950] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:16 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:16.688903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058f2a9-9cea-4aef-8ce7-9e2fcdf69e42 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.688903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058f2a9-9cea-4aef-8ce7-9e2fcdf69e42 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.688903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058f2a9-9cea-4aef-8ce7-9e2fcdf69e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.697805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 986/1951] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:16 2021] PUT /identity/v3/projects/331efd622a2746b892acb85e67417e33/users/483eb959772c450fbad6f7130377c90b/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:16.698506 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a08518-7d33-432b-bd48-6817c2aad8d8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:16.700215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e2a08518-7d33-432b-bd48-6817c2aad8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:16.707192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-d058f2a9-9cea-4aef-8ce7-9e2fcdf69e42 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:16.708389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d058f2a9-9cea-4aef-8ce7-9e2fcdf69e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:16.774081 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a08518-7d33-432b-bd48-6817c2aad8d8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:16.778021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 966/1952] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:16.779483 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50e831-722b-4e6a-b7df-f424da3ee2df None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.779926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50e831-722b-4e6a-b7df-f424da3ee2df None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.780331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50e831-722b-4e6a-b7df-f424da3ee2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.784465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752d72d-5536-4012-a7df-ac1afab70e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:16.785309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752d72d-5536-4012-a7df-ac1afab70e00 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.785760 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752d72d-5536-4012-a7df-ac1afab70e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.786201 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752d72d-5536-4012-a7df-ac1afab70e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.787023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752d72d-5536-4012-a7df-ac1afab70e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:16.789653 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752d72d-5536-4012-a7df-ac1afab70e00 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:16.817991 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-bf50e831-722b-4e6a-b7df-f424da3ee2df None None] MFA Rules not processed for user `483eb959772c450fbad6f7130377c90b`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:16.819311 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-bf50e831-722b-4e6a-b7df-f424da3ee2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:16.896690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 967/1953] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:16 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:16.898965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2b149-00f6-4071-a7a8-d1a4deacbf2d None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:16.899393 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2b149-00f6-4071-a7a8-d1a4deacbf2d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:16.899686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2b149-00f6-4071-a7a8-d1a4deacbf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:16.914142 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 987/1954] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:16 2021] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:16.914968 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752d72d-5536-4012-a7df-ac1afab70e00 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:16.918757 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8752d72d-5536-4012-a7df-ac1afab70e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:16.922557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e6b2b149-00f6-4071-a7a8-d1a4deacbf2d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:16.923755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e6b2b149-00f6-4071-a7a8-d1a4deacbf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:17.024180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 968/1955] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:17.024841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2b149-00f6-4071-a7a8-d1a4deacbf2d None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:17.031372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752d72d-5536-4012-a7df-ac1afab70e00 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:17.033903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2b149-00f6-4071-a7a8-d1a4deacbf2d None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:17.036116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68827e5d-39e8-4fd0-8fe9-5c772d300e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:17.037091 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68827e5d-39e8-4fd0-8fe9-5c772d300e68 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:17.037381 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68827e5d-39e8-4fd0-8fe9-5c772d300e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:17.038561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68827e5d-39e8-4fd0-8fe9-5c772d300e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:17.039143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416186f-2353-4d81-bfbf-dfb5f41d2aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:17.039621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68827e5d-39e8-4fd0-8fe9-5c772d300e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:17.040086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416186f-2353-4d81-bfbf-dfb5f41d2aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:17.040175 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416186f-2353-4d81-bfbf-dfb5f41d2aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:17.040427 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416186f-2353-4d81-bfbf-dfb5f41d2aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:17.041123 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416186f-2353-4d81-bfbf-dfb5f41d2aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:17.041544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68827e5d-39e8-4fd0-8fe9-5c772d300e68 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:17.043043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416186f-2353-4d81-bfbf-dfb5f41d2aa9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:17.162160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 969/1956] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:17 2021] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:17.166330 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416186f-2353-4d81-bfbf-dfb5f41d2aa9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:17.175814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416186f-2353-4d81-bfbf-dfb5f41d2aa9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:17.180719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09443e-2f76-4a6a-800c-4e2b2d21b877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:17.181382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09443e-2f76-4a6a-800c-4e2b2d21b877 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:17.181667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09443e-2f76-4a6a-800c-4e2b2d21b877 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:17.181980 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09443e-2f76-4a6a-800c-4e2b2d21b877 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:17.183191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09443e-2f76-4a6a-800c-4e2b2d21b877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:37:17.183191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09443e-2f76-4a6a-800c-4e2b2d21b877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:17.184723 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09443e-2f76-4a6a-800c-4e2b2d21b877 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:17.211784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 988/1957] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:16 2021] POST /identity/v3/projects => generated 375 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:17.211784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68827e5d-39e8-4fd0-8fe9-5c772d300e68 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:17.288103 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68827e5d-39e8-4fd0-8fe9-5c772d300e68 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:17.301088 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da80cf-d74f-4cd0-a51a-1b7eb9dad781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:17.302025 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da80cf-d74f-4cd0-a51a-1b7eb9dad781 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:17.302224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da80cf-d74f-4cd0-a51a-1b7eb9dad781 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:17.302378 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da80cf-d74f-4cd0-a51a-1b7eb9dad781 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:17.303122 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da80cf-d74f-4cd0-a51a-1b7eb9dad781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:17.305194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da80cf-d74f-4cd0-a51a-1b7eb9dad781 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:17.316932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 989/1958] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:17 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:17.317887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da80cf-d74f-4cd0-a51a-1b7eb9dad781 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:17.592366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da80cf-d74f-4cd0-a51a-1b7eb9dad781 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:17.592366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf73b92-8062-4c89-839d-11518cbd8968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:17.592366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf73b92-8062-4c89-839d-11518cbd8968 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:17.592366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf73b92-8062-4c89-839d-11518cbd8968 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:17.593352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf73b92-8062-4c89-839d-11518cbd8968 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:17.593352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf73b92-8062-4c89-839d-11518cbd8968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:17.593352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf73b92-8062-4c89-839d-11518cbd8968 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:17.593571 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 970/1959] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:37:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:37:17.593571 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09443e-2f76-4a6a-800c-4e2b2d21b877 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:17.593571 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09443e-2f76-4a6a-800c-4e2b2d21b877 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:17.593571 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c589fe8-25ed-4b37-b5a5-ddfb45b99ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:17.594272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589fe8-25ed-4b37-b5a5-ddfb45b99ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:17.594272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589fe8-25ed-4b37-b5a5-ddfb45b99ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:17.594272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589fe8-25ed-4b37-b5a5-ddfb45b99ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:17.594272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c589fe8-25ed-4b37-b5a5-ddfb45b99ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:17.594272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c589fe8-25ed-4b37-b5a5-ddfb45b99ea5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:17.594272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 971/1960] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:17 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:17.594686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c589fe8-25ed-4b37-b5a5-ddfb45b99ea5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:17.594686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c589fe8-25ed-4b37-b5a5-ddfb45b99ea5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:17.594686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36df82-78c0-4535-87f4-a808ed786c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:17.594686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36df82-78c0-4535-87f4-a808ed786c92 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:17.594996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36df82-78c0-4535-87f4-a808ed786c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:17.594996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36df82-78c0-4535-87f4-a808ed786c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:17.594996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36df82-78c0-4535-87f4-a808ed786c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:17.594996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36df82-78c0-4535-87f4-a808ed786c92 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:17.730101 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 990/1961] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:17 2021] POST /identity/v3/users => generated 294 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:17.864189 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 972/1962] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:17 2021] POST /identity/v3/projects => generated 373 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:17.866422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf73b92-8062-4c89-839d-11518cbd8968 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:17.866422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf73b92-8062-4c89-839d-11518cbd8968 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:17.866422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6786e5a-65fa-4409-8446-46003aa77cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:17.866422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786e5a-65fa-4409-8446-46003aa77cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:17.867202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786e5a-65fa-4409-8446-46003aa77cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:17.867202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786e5a-65fa-4409-8446-46003aa77cb1 admin admin] PATH_INFO: `/v3/projects/cbe96f3b7a464859b0fd55ee46e44edd/users/e401d3c069d54c0dac70e4518e8f4928/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:17.867202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6786e5a-65fa-4409-8446-46003aa77cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe96f3b7a464859b0fd55ee46e44edd, user_id=e401d3c069d54c0dac70e4518e8f4928, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:17.867202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6786e5a-65fa-4409-8446-46003aa77cb1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:17.867666 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36df82-78c0-4535-87f4-a808ed786c92 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:17.873328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36df82-78c0-4535-87f4-a808ed786c92 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:17.880240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1599dd2-263b-4cd9-a0ce-9aa46efb553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:17.880528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1599dd2-263b-4cd9-a0ce-9aa46efb553b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:17.880779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1599dd2-263b-4cd9-a0ce-9aa46efb553b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:17.881041 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1599dd2-263b-4cd9-a0ce-9aa46efb553b admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:17.881806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1599dd2-263b-4cd9-a0ce-9aa46efb553b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:17.883541 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1599dd2-263b-4cd9-a0ce-9aa46efb553b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:17.894208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 973/1963] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:17 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:37:17.895049 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1599dd2-263b-4cd9-a0ce-9aa46efb553b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:17.919005 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1599dd2-263b-4cd9-a0ce-9aa46efb553b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:17.924858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485b69a-d3f9-4280-bfe5-d6dbad268c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:17.929014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485b69a-d3f9-4280-bfe5-d6dbad268c66 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:17.929014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485b69a-d3f9-4280-bfe5-d6dbad268c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:17.929014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485b69a-d3f9-4280-bfe5-d6dbad268c66 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:17.929014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485b69a-d3f9-4280-bfe5-d6dbad268c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:17.934220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485b69a-d3f9-4280-bfe5-d6dbad268c66 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:18.058157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 974/1964] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:17 2021] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:18.059099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485b69a-d3f9-4280-bfe5-d6dbad268c66 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:18.061564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 991/1965] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:17 2021] PUT /identity/v3/projects/cbe96f3b7a464859b0fd55ee46e44edd/users/e401d3c069d54c0dac70e4518e8f4928/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:18.062580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6786e5a-65fa-4409-8446-46003aa77cb1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:18.069336 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485b69a-d3f9-4280-bfe5-d6dbad268c66 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:18.175737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6786e5a-65fa-4409-8446-46003aa77cb1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:18.177646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f693afa-61f2-4d73-9e5f-b515650400b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:18.177646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f693afa-61f2-4d73-9e5f-b515650400b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:18.181068 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f693afa-61f2-4d73-9e5f-b515650400b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:18.181068 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f693afa-61f2-4d73-9e5f-b515650400b2 admin admin] PATH_INFO: `/v3/projects/d0542256f5c643c5868b32d0991c1071/users/64466dca813140179dc6ac0366abd057/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:18.189805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dc505-a1b6-4c7b-81eb-0db7dd6a6894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:18.190774 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc505-a1b6-4c7b-81eb-0db7dd6a6894 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:18.193031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc505-a1b6-4c7b-81eb-0db7dd6a6894 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:18.193530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc505-a1b6-4c7b-81eb-0db7dd6a6894 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:18.195040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dc505-a1b6-4c7b-81eb-0db7dd6a6894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:18.197401 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f693afa-61f2-4d73-9e5f-b515650400b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0542256f5c643c5868b32d0991c1071, user_id=64466dca813140179dc6ac0366abd057, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:18.200029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dc505-a1b6-4c7b-81eb-0db7dd6a6894 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:18.200855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f693afa-61f2-4d73-9e5f-b515650400b2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:18.222851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 992/1966] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:18 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:18.224702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02f8fe-0537-4cc6-b64f-ceabe9f86d4f None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:18.225026 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02f8fe-0537-4cc6-b64f-ceabe9f86d4f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:18.225847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02f8fe-0537-4cc6-b64f-ceabe9f86d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:18.263750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-ce02f8fe-0537-4cc6-b64f-ceabe9f86d4f None None] MFA Rules not processed for user `e401d3c069d54c0dac70e4518e8f4928`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:18.263750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ce02f8fe-0537-4cc6-b64f-ceabe9f86d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:18.321829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 975/1967] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:18 2021] PUT /identity/v3/projects/d0542256f5c643c5868b32d0991c1071/users/64466dca813140179dc6ac0366abd057/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:18.322892 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f693afa-61f2-4d73-9e5f-b515650400b2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:18.328373 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 993/1968] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:18 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:18.329303 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02f8fe-0537-4cc6-b64f-ceabe9f86d4f None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:18.340172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02f8fe-0537-4cc6-b64f-ceabe9f86d4f None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:18.388908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f693afa-61f2-4d73-9e5f-b515650400b2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:18.393567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0484f6-b4a7-420c-9926-60d8718d7a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:18.394270 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0484f6-b4a7-420c-9926-60d8718d7a06 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:18.394561 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0484f6-b4a7-420c-9926-60d8718d7a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:18.394828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0484f6-b4a7-420c-9926-60d8718d7a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:18.395535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0484f6-b4a7-420c-9926-60d8718d7a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:18.400783 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbce19-5570-49d5-bd81-122774d2ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:18.401470 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbce19-5570-49d5-bd81-122774d2ffa9 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:18.401593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0484f6-b4a7-420c-9926-60d8718d7a06 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:18.401742 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbce19-5570-49d5-bd81-122774d2ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:18.402226 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbce19-5570-49d5-bd81-122774d2ffa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:18.403221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbce19-5570-49d5-bd81-122774d2ffa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:18.405474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbce19-5570-49d5-bd81-122774d2ffa9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:18.415900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 976/1969] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:18 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:18.415900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0484f6-b4a7-420c-9926-60d8718d7a06 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:18.420161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 994/1970] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:18 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:18.420658 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbce19-5570-49d5-bd81-122774d2ffa9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:18.423925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0484f6-b4a7-420c-9926-60d8718d7a06 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:18.428696 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf1ba-a70d-432f-8cc7-95a19d2531ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:18.429345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf1ba-a70d-432f-8cc7-95a19d2531ef admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:18.429622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf1ba-a70d-432f-8cc7-95a19d2531ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:18.429968 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf1ba-a70d-432f-8cc7-95a19d2531ef admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:18.430648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbf1ba-a70d-432f-8cc7-95a19d2531ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:18.430795 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbce19-5570-49d5-bd81-122774d2ffa9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:18.432509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbf1ba-a70d-432f-8cc7-95a19d2531ef admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:18.435420 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37949bc5-11d2-40e8-b817-73e289ef2bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:18.436281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37949bc5-11d2-40e8-b817-73e289ef2bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:18.436561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37949bc5-11d2-40e8-b817-73e289ef2bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:18.436836 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37949bc5-11d2-40e8-b817-73e289ef2bdf admin admin] PATH_INFO: `/v3/projects/7a1907dd57c540caa0af454a289ce3b2/users/f6ead738f3784f24997357c550159d22/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:18.452495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37949bc5-11d2-40e8-b817-73e289ef2bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1907dd57c540caa0af454a289ce3b2, user_id=f6ead738f3784f24997357c550159d22, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:18.455522 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37949bc5-11d2-40e8-b817-73e289ef2bdf admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:18.567880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 977/1971] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:18 2021] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:18.568966 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf1ba-a70d-432f-8cc7-95a19d2531ef admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:18.595370 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 995/1972] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:18 2021] PUT /identity/v3/projects/7a1907dd57c540caa0af454a289ce3b2/users/f6ead738f3784f24997357c550159d22/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:18.596311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37949bc5-11d2-40e8-b817-73e289ef2bdf admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:18.644079 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf1ba-a70d-432f-8cc7-95a19d2531ef admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:18.668475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37949bc5-11d2-40e8-b817-73e289ef2bdf admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:18.673384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251327c7-14ad-40af-b94c-a0729f0d4e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:18.674078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251327c7-14ad-40af-b94c-a0729f0d4e3b admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:18.674364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251327c7-14ad-40af-b94c-a0729f0d4e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:18.674637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251327c7-14ad-40af-b94c-a0729f0d4e3b admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:18.675317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251327c7-14ad-40af-b94c-a0729f0d4e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:18.677235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251327c7-14ad-40af-b94c-a0729f0d4e3b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:18.701960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45515715-e399-4edb-aa6e-81b92c5d171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:18.702850 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45515715-e399-4edb-aa6e-81b92c5d171a admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:18.703243 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45515715-e399-4edb-aa6e-81b92c5d171a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:18.703396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45515715-e399-4edb-aa6e-81b92c5d171a admin admin] PATH_INFO: `/v3/projects/d0542256f5c643c5868b32d0991c1071/users/64466dca813140179dc6ac0366abd057/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:18.705339 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45515715-e399-4edb-aa6e-81b92c5d171a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0542256f5c643c5868b32d0991c1071, user_id=64466dca813140179dc6ac0366abd057, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:18.707976 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45515715-e399-4edb-aa6e-81b92c5d171a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:18.719520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 978/1973] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:18 2021] PUT /identity/v3/projects/d0542256f5c643c5868b32d0991c1071/users/64466dca813140179dc6ac0366abd057/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:18.720805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf70bf5-bc14-40f8-9b78-280bedac9b0c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:18.721090 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf70bf5-bc14-40f8-9b78-280bedac9b0c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:18.721369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf70bf5-bc14-40f8-9b78-280bedac9b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:18.747437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-eaf70bf5-bc14-40f8-9b78-280bedac9b0c None None] MFA Rules not processed for user `f6ead738f3784f24997357c550159d22`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:18.748668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-eaf70bf5-bc14-40f8-9b78-280bedac9b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:18.812597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 979/1974] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:18 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:18.814026 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e015-d7a7-4858-a475-62e3827fbfaa None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:18.814593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e015-d7a7-4858-a475-62e3827fbfaa None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:18.814871 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e015-d7a7-4858-a475-62e3827fbfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:18.827588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 996/1975] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:18 2021] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:18.829088 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251327c7-14ad-40af-b94c-a0729f0d4e3b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:18.832152 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-251327c7-14ad-40af-b94c-a0729f0d4e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:18.844058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-9ce8e015-d7a7-4858-a475-62e3827fbfaa None None] MFA Rules not processed for user `64466dca813140179dc6ac0366abd057`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:18.845290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-9ce8e015-d7a7-4858-a475-62e3827fbfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:18.900987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251327c7-14ad-40af-b94c-a0729f0d4e3b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:18.917451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 980/1976] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:18 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:18.918340 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e015-d7a7-4858-a475-62e3827fbfaa None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:18.971486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb36b-3e55-4110-9209-68adf0832ad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:18.972150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb36b-3e55-4110-9209-68adf0832ad7 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:18.972435 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb36b-3e55-4110-9209-68adf0832ad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:18.972716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb36b-3e55-4110-9209-68adf0832ad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:18.981469 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bb36b-3e55-4110-9209-68adf0832ad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:18.986210 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bb36b-3e55-4110-9209-68adf0832ad7 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:18.992361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 997/1977] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:18 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:18.993152 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb36b-3e55-4110-9209-68adf0832ad7 service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:18.994507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-700bb36b-3e55-4110-9209-68adf0832ad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:19.002411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e015-d7a7-4858-a475-62e3827fbfaa None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:19.006160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb36b-3e55-4110-9209-68adf0832ad7 service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:19.015170 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59114a46-2860-4bdc-ada1-cdd4f2fb2196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:19.016031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59114a46-2860-4bdc-ada1-cdd4f2fb2196 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:19.016543 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59114a46-2860-4bdc-ada1-cdd4f2fb2196 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:19.017249 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59114a46-2860-4bdc-ada1-cdd4f2fb2196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:19.018845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-59114a46-2860-4bdc-ada1-cdd4f2fb2196 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:19.018968 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b46aac-ef96-48ad-b1e9-746227f202db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:19.019574 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b46aac-ef96-48ad-b1e9-746227f202db admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:19.019682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b46aac-ef96-48ad-b1e9-746227f202db admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:19.019964 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b46aac-ef96-48ad-b1e9-746227f202db admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:19.020650 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b46aac-ef96-48ad-b1e9-746227f202db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:19.022798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b46aac-ef96-48ad-b1e9-746227f202db admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:19.033879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 981/1978] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:18 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:19.034614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b46aac-ef96-48ad-b1e9-746227f202db admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:19.045988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b46aac-ef96-48ad-b1e9-746227f202db admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:19.050457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c8ca4-cc6f-43fb-bd25-6bf335c88083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:19.052464 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c8ca4-cc6f-43fb-bd25-6bf335c88083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:19.052820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c8ca4-cc6f-43fb-bd25-6bf335c88083 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:19.053697 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c8ca4-cc6f-43fb-bd25-6bf335c88083 admin admin] PATH_INFO: `/v3/users/f6ead738f3784f24997357c550159d22` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:19.055693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c8ca4-cc6f-43fb-bd25-6bf335c88083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ead738f3784f24997357c550159d22)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:19.058514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c8ca4-cc6f-43fb-bd25-6bf335c88083 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:19.088295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59114a46-2860-4bdc-ada1-cdd4f2fb2196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:19.089743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59114a46-2860-4bdc-ada1-cdd4f2fb2196 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:19.099506 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 998/1979] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:18 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:19.101256 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59114a46-2860-4bdc-ada1-cdd4f2fb2196 service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:19.112679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59114a46-2860-4bdc-ada1-cdd4f2fb2196 service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:19.121499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf8475-040a-4e21-b3ce-8b8f7a96d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:19.122438 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8475-040a-4e21-b3ce-8b8f7a96d11c admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:19.122720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8475-040a-4e21-b3ce-8b8f7a96d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:19.122999 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8475-040a-4e21-b3ce-8b8f7a96d11c admin admin] PATH_INFO: `/v3/projects/2fd49238eb374b1787e877a69cd1d3e2/users/4e8ad07195c44e81bc6fd7024744e235/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:19.138380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf8475-040a-4e21-b3ce-8b8f7a96d11c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd49238eb374b1787e877a69cd1d3e2, user_id=4e8ad07195c44e81bc6fd7024744e235, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:19.144776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf8475-040a-4e21-b3ce-8b8f7a96d11c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:19.299610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 999/1980] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:19 2021] PUT /identity/v3/projects/2fd49238eb374b1787e877a69cd1d3e2/users/4e8ad07195c44e81bc6fd7024744e235/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:19.305786 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf8475-040a-4e21-b3ce-8b8f7a96d11c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:19.348268 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9c6c8ca4-cc6f-43fb-bd25-6bf335c88083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ead738f3784f24997357c550159d22'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:19.349535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9c6c8ca4-cc6f-43fb-bd25-6bf335c88083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ead738f3784f24997357c550159d22'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:19.361307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9c6c8ca4-cc6f-43fb-bd25-6bf335c88083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ead738f3784f24997357c550159d22'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:19.377792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf8475-040a-4e21-b3ce-8b8f7a96d11c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:19.379928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77615db-3981-47ee-b590-7d72793f2f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:19.380595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77615db-3981-47ee-b590-7d72793f2f48 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:19.380881 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77615db-3981-47ee-b590-7d72793f2f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:19.381667 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77615db-3981-47ee-b590-7d72793f2f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:19.382454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77615db-3981-47ee-b590-7d72793f2f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:19.384041 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77615db-3981-47ee-b590-7d72793f2f48 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:19.394486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1000/1981] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:19 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:37:19.399015 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77615db-3981-47ee-b590-7d72793f2f48 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:19.413338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77615db-3981-47ee-b590-7d72793f2f48 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:19.417559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97a0ea-4468-46e7-8e57-8f51858b098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:19.418500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97a0ea-4468-46e7-8e57-8f51858b098a admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:19.418776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97a0ea-4468-46e7-8e57-8f51858b098a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:19.419063 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97a0ea-4468-46e7-8e57-8f51858b098a admin admin] PATH_INFO: `/v3/projects/2fd49238eb374b1787e877a69cd1d3e2/users/4e8ad07195c44e81bc6fd7024744e235/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:19.421447 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97a0ea-4468-46e7-8e57-8f51858b098a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd49238eb374b1787e877a69cd1d3e2, user_id=4e8ad07195c44e81bc6fd7024744e235, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:19.424593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97a0ea-4468-46e7-8e57-8f51858b098a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:19.440900 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1001/1982] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:19 2021] PUT /identity/v3/projects/2fd49238eb374b1787e877a69cd1d3e2/users/4e8ad07195c44e81bc6fd7024744e235/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:19.461741 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3488e31-4269-42b3-8c0c-2f8e30512a2a None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:19.462067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3488e31-4269-42b3-8c0c-2f8e30512a2a None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:19.462355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3488e31-4269-42b3-8c0c-2f8e30512a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:19.477555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9c6c8ca4-cc6f-43fb-bd25-6bf335c88083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ead738f3784f24997357c550159d22'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:19.489834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9c6c8ca4-cc6f-43fb-bd25-6bf335c88083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ead738f3784f24997357c550159d22'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:19.490727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b3488e31-4269-42b3-8c0c-2f8e30512a2a None None] MFA Rules not processed for user `4e8ad07195c44e81bc6fd7024744e235`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:19.492437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b3488e31-4269-42b3-8c0c-2f8e30512a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:19.496138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 982/1983] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:19 2021] DELETE /identity/v3/users/f6ead738f3784f24997357c550159d22 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:19.500695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc70d1-0162-4514-9aa5-df413eed1887 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:19.500986 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc70d1-0162-4514-9aa5-df413eed1887 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:19.501262 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc70d1-0162-4514-9aa5-df413eed1887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:19.519350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c0bc70d1-0162-4514-9aa5-df413eed1887 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:19.520552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c0bc70d1-0162-4514-9aa5-df413eed1887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:19.563613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1002/1984] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:19 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:19.575876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3488e31-4269-42b3-8c0c-2f8e30512a2a None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:19.577275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b3488e31-4269-42b3-8c0c-2f8e30512a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:19.580284 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 983/1985] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:19.590783 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc70d1-0162-4514-9aa5-df413eed1887 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:19.592246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c0bc70d1-0162-4514-9aa5-df413eed1887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:19.643875 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3488e31-4269-42b3-8c0c-2f8e30512a2a None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:19.649020 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc70d1-0162-4514-9aa5-df413eed1887 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:19.652874 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbfaa9-79fc-4a82-a90b-547118df16cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:19.653867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbfaa9-79fc-4a82-a90b-547118df16cf service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:19.654173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbfaa9-79fc-4a82-a90b-547118df16cf service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:19.654446 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbfaa9-79fc-4a82-a90b-547118df16cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:19.668316 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbfaa9-79fc-4a82-a90b-547118df16cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:19.669682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbfaa9-79fc-4a82-a90b-547118df16cf service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:19.680043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 984/1986] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:37:19.700649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48e98a-50fc-4c19-88a6-d7a1ecae35d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:19.701389 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48e98a-50fc-4c19-88a6-d7a1ecae35d6 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:19.701754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48e98a-50fc-4c19-88a6-d7a1ecae35d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:19.702116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48e98a-50fc-4c19-88a6-d7a1ecae35d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:19.770963 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48e98a-50fc-4c19-88a6-d7a1ecae35d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:19.773186 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48e98a-50fc-4c19-88a6-d7a1ecae35d6 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:19.783339 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1003/1987] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:19 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:20.188164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbfaa9-79fc-4a82-a90b-547118df16cf service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:20.192566 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-26cbfaa9-79fc-4a82-a90b-547118df16cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:20.202950 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbfaa9-79fc-4a82-a90b-547118df16cf service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:20.207827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:20.208674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:20.208951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:20.209370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832 admin admin] PATH_INFO: `/v3/projects/7a1907dd57c540caa0af454a289ce3b2` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:20.211374 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1907dd57c540caa0af454a289ce3b2)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:20.213227 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:20.370251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1907dd57c540caa0af454a289ce3b2', 'request_id': 'req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:20.500797 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1907dd57c540caa0af454a289ce3b2', 'request_id': 'req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:20.512905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1907dd57c540caa0af454a289ce3b2', 'request_id': 'req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:20.528174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832 admin admin] The token cache is being invalidate because project 7a1907dd57c540caa0af454a289ce3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:20.528462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:20.529126 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6ce5679b-3ab3-4f05-b18a-489b3ddfc832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:20.530712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 985/1988] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:20 2021] DELETE /identity/v3/projects/7a1907dd57c540caa0af454a289ce3b2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:20.537020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d7d4-566f-47df-8d0d-1240bb39d35f None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:20.538106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d7d4-566f-47df-8d0d-1240bb39d35f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:20.538215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d7d4-566f-47df-8d0d-1240bb39d35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:20.556112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-8692d7d4-566f-47df-8d0d-1240bb39d35f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:20.557386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-8692d7d4-566f-47df-8d0d-1240bb39d35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:20.616533 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1004/1989] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:20.625523 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb3acd-cd56-4f24-875d-8aa5560ac362 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:20.630319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb3acd-cd56-4f24-875d-8aa5560ac362 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:20.630319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb3acd-cd56-4f24-875d-8aa5560ac362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:20.645034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0adb3acd-cd56-4f24-875d-8aa5560ac362 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:20.646310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0adb3acd-cd56-4f24-875d-8aa5560ac362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:20.654940 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 986/1990] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:20.659221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d7d4-566f-47df-8d0d-1240bb39d35f None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:20.669131 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d7d4-566f-47df-8d0d-1240bb39d35f None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:20.673951 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed2610-06b1-4024-bcdb-93ef5e243a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:20.674610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed2610-06b1-4024-bcdb-93ef5e243a69 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:20.674890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed2610-06b1-4024-bcdb-93ef5e243a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:20.675163 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed2610-06b1-4024-bcdb-93ef5e243a69 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:20.675878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed2610-06b1-4024-bcdb-93ef5e243a69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:37:20.676182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed2610-06b1-4024-bcdb-93ef5e243a69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:20.677784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed2610-06b1-4024-bcdb-93ef5e243a69 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:20.689291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1005/1991] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:37:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:37:20.694583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb3acd-cd56-4f24-875d-8aa5560ac362 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:20.703637 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb3acd-cd56-4f24-875d-8aa5560ac362 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:20.708398 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902e48f-2c5c-4bea-a0cf-f2a7e9937c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:20.709048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902e48f-2c5c-4bea-a0cf-f2a7e9937c35 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:20.709854 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902e48f-2c5c-4bea-a0cf-f2a7e9937c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:20.710670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902e48f-2c5c-4bea-a0cf-f2a7e9937c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:20.711359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902e48f-2c5c-4bea-a0cf-f2a7e9937c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:20.713465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902e48f-2c5c-4bea-a0cf-f2a7e9937c35 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:20.868084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 987/1992] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:20 2021] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:20.872210 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed2610-06b1-4024-bcdb-93ef5e243a69 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:20.882542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed2610-06b1-4024-bcdb-93ef5e243a69 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:20.950391 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06636193-869e-44ce-a126-e29c83ab23e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:20.951403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636193-869e-44ce-a126-e29c83ab23e6 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:20.952043 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636193-869e-44ce-a126-e29c83ab23e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:20.952326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636193-869e-44ce-a126-e29c83ab23e6 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:20.953068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06636193-869e-44ce-a126-e29c83ab23e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:20.955619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06636193-869e-44ce-a126-e29c83ab23e6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:21.064512 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1006/1993] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:20 2021] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:37:21.069457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902e48f-2c5c-4bea-a0cf-f2a7e9937c35 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:21.079466 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902e48f-2c5c-4bea-a0cf-f2a7e9937c35 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:21.090808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355abfa1-5af0-4258-92b5-a2dea90ed193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:21.090808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355abfa1-5af0-4258-92b5-a2dea90ed193 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:21.090808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355abfa1-5af0-4258-92b5-a2dea90ed193 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:21.090808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355abfa1-5af0-4258-92b5-a2dea90ed193 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:21.091453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355abfa1-5af0-4258-92b5-a2dea90ed193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:21.091453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355abfa1-5af0-4258-92b5-a2dea90ed193 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:21.105824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 988/1994] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:21 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:21.107255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06636193-869e-44ce-a126-e29c83ab23e6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:21.117228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06636193-869e-44ce-a126-e29c83ab23e6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:21.122896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d7f61-0f6c-456b-a1c6-254d9f9009d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:21.123765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d7f61-0f6c-456b-a1c6-254d9f9009d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:21.124051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d7f61-0f6c-456b-a1c6-254d9f9009d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:21.124330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d7f61-0f6c-456b-a1c6-254d9f9009d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:21.125116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d7f61-0f6c-456b-a1c6-254d9f9009d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:21.126794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d7f61-0f6c-456b-a1c6-254d9f9009d9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:21.138504 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1007/1995] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:21 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:21.142817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355abfa1-5af0-4258-92b5-a2dea90ed193 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:21.154763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355abfa1-5af0-4258-92b5-a2dea90ed193 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:21.162642 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f12241-28a5-48a0-82ec-3bb36e83c147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:21.163544 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f12241-28a5-48a0-82ec-3bb36e83c147 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:21.163827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f12241-28a5-48a0-82ec-3bb36e83c147 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:21.164101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f12241-28a5-48a0-82ec-3bb36e83c147 admin admin] PATH_INFO: `/v3/projects/40294af2fb414e3a9bf0dc3e2cf861b4/users/2695403c5ae44b67ac7f1ff61264bd38/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:21.179636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f12241-28a5-48a0-82ec-3bb36e83c147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40294af2fb414e3a9bf0dc3e2cf861b4, user_id=2695403c5ae44b67ac7f1ff61264bd38, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:21.182387 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f12241-28a5-48a0-82ec-3bb36e83c147 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:21.214103 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d7f61-0f6c-456b-a1c6-254d9f9009d9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:21.215813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-691d7f61-0f6c-456b-a1c6-254d9f9009d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:21.274305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d7f61-0f6c-456b-a1c6-254d9f9009d9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:21.278238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed027bb1-6cc5-4ccc-ad71-898be1de0733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:21.278918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed027bb1-6cc5-4ccc-ad71-898be1de0733 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:21.279203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed027bb1-6cc5-4ccc-ad71-898be1de0733 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:21.283872 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed027bb1-6cc5-4ccc-ad71-898be1de0733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:21.283872 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ed027bb1-6cc5-4ccc-ad71-898be1de0733 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:21.307317 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 989/1996] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:21 2021] PUT /identity/v3/projects/40294af2fb414e3a9bf0dc3e2cf861b4/users/2695403c5ae44b67ac7f1ff61264bd38/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:21.317665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d01cd3-d0a1-40be-9e14-1a09cbc2f294 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:21.318041 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d01cd3-d0a1-40be-9e14-1a09cbc2f294 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:21.318386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d01cd3-d0a1-40be-9e14-1a09cbc2f294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:21.346419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-24d01cd3-d0a1-40be-9e14-1a09cbc2f294 None None] MFA Rules not processed for user `2695403c5ae44b67ac7f1ff61264bd38`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:21.348527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-24d01cd3-d0a1-40be-9e14-1a09cbc2f294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:21.352337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed027bb1-6cc5-4ccc-ad71-898be1de0733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:21.353957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed027bb1-6cc5-4ccc-ad71-898be1de0733 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:21.364011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1008/1997] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:21 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:37:21.440152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 990/1998] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:21 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:21.446222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed027bb1-6cc5-4ccc-ad71-898be1de0733 service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:21.448119 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ed027bb1-6cc5-4ccc-ad71-898be1de0733 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:21.460151 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed027bb1-6cc5-4ccc-ad71-898be1de0733 service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:21.515480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3a9db-6ee8-42a2-9b10-8812648beb84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:21.516269 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a9db-6ee8-42a2-9b10-8812648beb84 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:21.516558 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a9db-6ee8-42a2-9b10-8812648beb84 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:21.516835 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a9db-6ee8-42a2-9b10-8812648beb84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:21.519051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-eba3a9db-6ee8-42a2-9b10-8812648beb84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:21.590529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3a9db-6ee8-42a2-9b10-8812648beb84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:21.591987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3a9db-6ee8-42a2-9b10-8812648beb84 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:21.603211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1009/1999] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:21 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:37:22.122446 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d01cd3-d0a1-40be-9e14-1a09cbc2f294 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:22.131978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d01cd3-d0a1-40be-9e14-1a09cbc2f294 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:22.135679 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c069e-8311-42b4-b15a-8926911329a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:22.136385 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c069e-8311-42b4-b15a-8926911329a3 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:22.136668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c069e-8311-42b4-b15a-8926911329a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:22.136939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c069e-8311-42b4-b15a-8926911329a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:22.144996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c069e-8311-42b4-b15a-8926911329a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:22.146453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c069e-8311-42b4-b15a-8926911329a3 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:22.155818 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 991/2000] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:22 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:24.018086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3a9db-6ee8-42a2-9b10-8812648beb84 service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:24.032245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3a9db-6ee8-42a2-9b10-8812648beb84 service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:24.037351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293f21-7d50-4593-84be-34324963d2bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:24.037351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293f21-7d50-4593-84be-34324963d2bd service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:24.038032 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293f21-7d50-4593-84be-34324963d2bd service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:24.038344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293f21-7d50-4593-84be-34324963d2bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:24.040273 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-fb293f21-7d50-4593-84be-34324963d2bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:24.113695 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb293f21-7d50-4593-84be-34324963d2bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:24.115197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb293f21-7d50-4593-84be-34324963d2bd service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:24.126328 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1010/2001] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:24 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:30.634500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38216c93-f6ab-4a3f-b5df-692d2afe74ed None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:30.635536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38216c93-f6ab-4a3f-b5df-692d2afe74ed None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:30.636022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38216c93-f6ab-4a3f-b5df-692d2afe74ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:30.657621 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-38216c93-f6ab-4a3f-b5df-692d2afe74ed None None] MFA Rules not processed for user `569387965b184cc3a1bc2aecdbede0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:30.659124 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-38216c93-f6ab-4a3f-b5df-692d2afe74ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:30.719754 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 992/2002] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:30 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:30.793425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293f21-7d50-4593-84be-34324963d2bd service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:30.802976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293f21-7d50-4593-84be-34324963d2bd service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:30.807951 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d21f7-eb6d-41a8-9d22-8bb5415ed8bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:30.812508 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d21f7-eb6d-41a8-9d22-8bb5415ed8bb service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:30.812508 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d21f7-eb6d-41a8-9d22-8bb5415ed8bb service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:30.812508 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d21f7-eb6d-41a8-9d22-8bb5415ed8bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:30.812508 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-713d21f7-eb6d-41a8-9d22-8bb5415ed8bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:30.878550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d21f7-eb6d-41a8-9d22-8bb5415ed8bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:30.881456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d21f7-eb6d-41a8-9d22-8bb5415ed8bb service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:30.889987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1011/2003] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:30 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:37:33.560086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38216c93-f6ab-4a3f-b5df-692d2afe74ed None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:33.561675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-38216c93-f6ab-4a3f-b5df-692d2afe74ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:33.629438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38216c93-f6ab-4a3f-b5df-692d2afe74ed None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:33.634285 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:33.635167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:33.635476 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:33.635915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] PATH_INFO: `/v3/users/ad898ee517a24512a3fdedf74bb988f6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:33.637334 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad898ee517a24512a3fdedf74bb988f6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:33.639426 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:33.848345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad898ee517a24512a3fdedf74bb988f6'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:33.849406 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad898ee517a24512a3fdedf74bb988f6'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:33.861355 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad898ee517a24512a3fdedf74bb988f6'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:33.957343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad898ee517a24512a3fdedf74bb988f6'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:33.971333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad898ee517a24512a3fdedf74bb988f6'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:33.980006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 993/2004] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:33 2021] DELETE /identity/v3/users/ad898ee517a24512a3fdedf74bb988f6 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:33.983882 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c86b4-4f54-4794-8028-e1282abfa9a2 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:33.984385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c86b4-4f54-4794-8028-e1282abfa9a2 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:33.984633 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c86b4-4f54-4794-8028-e1282abfa9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:34.003307 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-e32c86b4-4f54-4794-8028-e1282abfa9a2 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:34.004642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e32c86b4-4f54-4794-8028-e1282abfa9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:34.092595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1012/2005] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:34.104148 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:34.105899 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:34.171619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e65682-92a2-4d1f-8a91-0c8fc4e8567c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:34.175525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49065e5-4235-43d6-b1f6-f167708a16c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:34.176264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49065e5-4235-43d6-b1f6-f167708a16c8 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:34.176662 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49065e5-4235-43d6-b1f6-f167708a16c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:34.177012 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49065e5-4235-43d6-b1f6-f167708a16c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:34.186819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49065e5-4235-43d6-b1f6-f167708a16c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:34.188243 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49065e5-4235-43d6-b1f6-f167708a16c8 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:34.199424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 994/2006] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:34.528898 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c86b4-4f54-4794-8028-e1282abfa9a2 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:34.532286 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e32c86b4-4f54-4794-8028-e1282abfa9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:34.548021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c86b4-4f54-4794-8028-e1282abfa9a2 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:34.554239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e666c2-7c2f-41c2-ac1b-a9933abb8e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:34.554615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e666c2-7c2f-41c2-ac1b-a9933abb8e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:34.555002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e666c2-7c2f-41c2-ac1b-a9933abb8e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:34.555447 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e666c2-7c2f-41c2-ac1b-a9933abb8e3b admin admin] PATH_INFO: `/v3/users/2695403c5ae44b67ac7f1ff61264bd38` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:34.557396 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e666c2-7c2f-41c2-ac1b-a9933abb8e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2695403c5ae44b67ac7f1ff61264bd38)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:34.559823 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e666c2-7c2f-41c2-ac1b-a9933abb8e3b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:34.830535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49065e5-4235-43d6-b1f6-f167708a16c8 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:34.831967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d49065e5-4235-43d6-b1f6-f167708a16c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:34.846382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49065e5-4235-43d6-b1f6-f167708a16c8 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:34.853993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:34.855194 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:34.855636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:34.855918 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] PATH_INFO: `/v3/projects/6a97f12e335d4a568bf45bb1bdcd27e7` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:34.857131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a97f12e335d4a568bf45bb1bdcd27e7)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:34.859197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:34.869267 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d3e666c2-7c2f-41c2-ac1b-a9933abb8e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2695403c5ae44b67ac7f1ff61264bd38'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:34.870405 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d3e666c2-7c2f-41c2-ac1b-a9933abb8e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2695403c5ae44b67ac7f1ff61264bd38'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:34.871218 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d3e666c2-7c2f-41c2-ac1b-a9933abb8e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2695403c5ae44b67ac7f1ff61264bd38'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:34.965960 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d3e666c2-7c2f-41c2-ac1b-a9933abb8e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2695403c5ae44b67ac7f1ff61264bd38'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:34.988655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d3e666c2-7c2f-41c2-ac1b-a9933abb8e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2695403c5ae44b67ac7f1ff61264bd38'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:34.994684 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a97f12e335d4a568bf45bb1bdcd27e7', 'request_id': 'req-f25efffa-ae7a-4c71-99ad-04107301c1cd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.002122 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1013/2007] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:34 2021] DELETE /identity/v3/users/2695403c5ae44b67ac7f1ff61264bd38 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:35.006704 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81fb6f-8113-4872-90ac-81a38511690e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:35.007001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81fb6f-8113-4872-90ac-81a38511690e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:35.007305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81fb6f-8113-4872-90ac-81a38511690e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:35.025989 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3c81fb6f-8113-4872-90ac-81a38511690e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:35.028821 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3c81fb6f-8113-4872-90ac-81a38511690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:35.086408 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a97f12e335d4a568bf45bb1bdcd27e7', 'request_id': 'req-f25efffa-ae7a-4c71-99ad-04107301c1cd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.090642 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a97f12e335d4a568bf45bb1bdcd27e7', 'request_id': 'req-f25efffa-ae7a-4c71-99ad-04107301c1cd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.102569 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1014/2008] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:35.108494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] The token cache is being invalidate because project 6a97f12e335d4a568bf45bb1bdcd27e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:35.109025 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.110052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81fb6f-8113-4872-90ac-81a38511690e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:35.110589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.111556 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3c81fb6f-8113-4872-90ac-81a38511690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:35.112941 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 995/2009] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:34 2021] DELETE /identity/v3/projects/6a97f12e335d4a568bf45bb1bdcd27e7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:35.116638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:35.118247 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:35.199695 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81fb6f-8113-4872-90ac-81a38511690e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:35.203552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6840d9-372d-44c0-85cb-2556d8b745e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:35.208913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6840d9-372d-44c0-85cb-2556d8b745e5 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:35.208913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6840d9-372d-44c0-85cb-2556d8b745e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:35.208913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6840d9-372d-44c0-85cb-2556d8b745e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:35.208913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-fd6840d9-372d-44c0-85cb-2556d8b745e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:35.218838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25efffa-ae7a-4c71-99ad-04107301c1cd admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:35.224032 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca33bb-ddbd-4daf-bf9b-e4f2d60b99e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:35.224990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca33bb-ddbd-4daf-bf9b-e4f2d60b99e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:35.225366 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca33bb-ddbd-4daf-bf9b-e4f2d60b99e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:35.226100 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca33bb-ddbd-4daf-bf9b-e4f2d60b99e0 admin admin] PATH_INFO: `/v3/users/483eb959772c450fbad6f7130377c90b` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:35.226948 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca33bb-ddbd-4daf-bf9b-e4f2d60b99e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=483eb959772c450fbad6f7130377c90b)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:35.230246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca33bb-ddbd-4daf-bf9b-e4f2d60b99e0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:35.231137 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6840d9-372d-44c0-85cb-2556d8b745e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:35.232782 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6840d9-372d-44c0-85cb-2556d8b745e5 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:35.248200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1015/2010] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:35.345364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6840d9-372d-44c0-85cb-2556d8b745e5 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:35.347848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-fd6840d9-372d-44c0-85cb-2556d8b745e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:35.362463 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6840d9-372d-44c0-85cb-2556d8b745e5 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:35.367804 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:35.368911 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:35.369735 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:35.369735 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] PATH_INFO: `/v3/users/d43f9aa80ebd42b4be370ac51f9d8d18` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:35.371061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43f9aa80ebd42b4be370ac51f9d8d18)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:35.373076 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:35.514570 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b2ca33bb-ddbd-4daf-bf9b-e4f2d60b99e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483eb959772c450fbad6f7130377c90b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.515185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b2ca33bb-ddbd-4daf-bf9b-e4f2d60b99e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483eb959772c450fbad6f7130377c90b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.526606 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b2ca33bb-ddbd-4daf-bf9b-e4f2d60b99e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483eb959772c450fbad6f7130377c90b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.592851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43f9aa80ebd42b4be370ac51f9d8d18'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.593490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43f9aa80ebd42b4be370ac51f9d8d18'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.594242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43f9aa80ebd42b4be370ac51f9d8d18'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.602369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b2ca33bb-ddbd-4daf-bf9b-e4f2d60b99e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483eb959772c450fbad6f7130377c90b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.619141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b2ca33bb-ddbd-4daf-bf9b-e4f2d60b99e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483eb959772c450fbad6f7130377c90b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.621093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 996/2011] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:35 2021] DELETE /identity/v3/users/483eb959772c450fbad6f7130377c90b => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:35.677068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43f9aa80ebd42b4be370ac51f9d8d18'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.689652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43f9aa80ebd42b4be370ac51f9d8d18'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:35.703885 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1016/2012] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:35 2021] DELETE /identity/v3/users/d43f9aa80ebd42b4be370ac51f9d8d18 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:35.709031 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34742615-fd96-4b1f-a025-6c8c1c6b8c04 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:35.709435 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34742615-fd96-4b1f-a025-6c8c1c6b8c04 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:35.710174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34742615-fd96-4b1f-a025-6c8c1c6b8c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:35.733251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-34742615-fd96-4b1f-a025-6c8c1c6b8c04 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:35.734875 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-34742615-fd96-4b1f-a025-6c8c1c6b8c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:35.747921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:35.750048 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:35.826359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 997/2013] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:35.836703 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34742615-fd96-4b1f-a025-6c8c1c6b8c04 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:35.842100 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-34742615-fd96-4b1f-a025-6c8c1c6b8c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:35.873443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf179a-8e7a-4a12-a777-0c0f0bd5e773 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:35.878354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5154a-b00f-4764-a373-8b55dcf18433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:35.879240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5154a-b00f-4764-a373-8b55dcf18433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:35.879596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5154a-b00f-4764-a373-8b55dcf18433 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:35.879978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5154a-b00f-4764-a373-8b55dcf18433 admin admin] PATH_INFO: `/v3/projects/40294af2fb414e3a9bf0dc3e2cf861b4` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:35.881186 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5154a-b00f-4764-a373-8b55dcf18433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40294af2fb414e3a9bf0dc3e2cf861b4)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:35.883234 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5154a-b00f-4764-a373-8b55dcf18433 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:35.906377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34742615-fd96-4b1f-a025-6c8c1c6b8c04 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:35.910423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d8cd9-e7d8-4bab-b5e3-f90eb765ca1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:35.911139 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d8cd9-e7d8-4bab-b5e3-f90eb765ca1d service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:35.911427 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d8cd9-e7d8-4bab-b5e3-f90eb765ca1d service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:35.911705 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d8cd9-e7d8-4bab-b5e3-f90eb765ca1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:35.921984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d8cd9-e7d8-4bab-b5e3-f90eb765ca1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:35.923362 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d8cd9-e7d8-4bab-b5e3-f90eb765ca1d service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:35.938293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 998/2014] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:37:36.011413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-bff5154a-b00f-4764-a373-8b55dcf18433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40294af2fb414e3a9bf0dc3e2cf861b4', 'request_id': 'req-bff5154a-b00f-4764-a373-8b55dcf18433'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.124517 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-bff5154a-b00f-4764-a373-8b55dcf18433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40294af2fb414e3a9bf0dc3e2cf861b4', 'request_id': 'req-bff5154a-b00f-4764-a373-8b55dcf18433'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.130655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-bff5154a-b00f-4764-a373-8b55dcf18433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40294af2fb414e3a9bf0dc3e2cf861b4', 'request_id': 'req-bff5154a-b00f-4764-a373-8b55dcf18433'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.153419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-bff5154a-b00f-4764-a373-8b55dcf18433 admin admin] The token cache is being invalidate because project 40294af2fb414e3a9bf0dc3e2cf861b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:36.153718 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-bff5154a-b00f-4764-a373-8b55dcf18433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.154550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-bff5154a-b00f-4764-a373-8b55dcf18433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.156984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1017/2015] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:35 2021] DELETE /identity/v3/projects/40294af2fb414e3a9bf0dc3e2cf861b4 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:36.162846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d22e6-1ed8-4ca6-b7b9-dcfb5366afdc None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:36.164760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d22e6-1ed8-4ca6-b7b9-dcfb5366afdc None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:36.164760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d22e6-1ed8-4ca6-b7b9-dcfb5366afdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:36.183009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-1b6d22e6-1ed8-4ca6-b7b9-dcfb5366afdc None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:36.184239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1b6d22e6-1ed8-4ca6-b7b9-dcfb5366afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:36.273936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 999/2016] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:36.278636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0aea63-f4ba-4d46-b619-bf6904bf9181 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:36.279149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0aea63-f4ba-4d46-b619-bf6904bf9181 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:36.279149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0aea63-f4ba-4d46-b619-bf6904bf9181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:36.303206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-9b0aea63-f4ba-4d46-b619-bf6904bf9181 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:36.304725 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-9b0aea63-f4ba-4d46-b619-bf6904bf9181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:36.317014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1018/2017] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:36.325358 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d22e6-1ed8-4ca6-b7b9-dcfb5366afdc None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:36.327309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0aea63-f4ba-4d46-b619-bf6904bf9181 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:36.330666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-9b0aea63-f4ba-4d46-b619-bf6904bf9181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:36.334074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d22e6-1ed8-4ca6-b7b9-dcfb5366afdc None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:36.341497 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b636c26-855f-4b15-9249-6cce3a08f66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:36.343140 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b636c26-855f-4b15-9249-6cce3a08f66a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:36.343836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b636c26-855f-4b15-9249-6cce3a08f66a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:36.344277 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b636c26-855f-4b15-9249-6cce3a08f66a admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:36.345293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b636c26-855f-4b15-9249-6cce3a08f66a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:37:36.345746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b636c26-855f-4b15-9249-6cce3a08f66a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:36.347658 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0aea63-f4ba-4d46-b619-bf6904bf9181 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:36.348668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b636c26-855f-4b15-9249-6cce3a08f66a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:36.355824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:36.363147 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:36.363147 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:36.363592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] PATH_INFO: `/v3/projects/331efd622a2746b892acb85e67417e33` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:36.365761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] RBAC: Authorizing `identity:delete_project(project_id=331efd622a2746b892acb85e67417e33)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:36.367118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1000/2018] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:37:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:37:36.367794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:36.372490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b636c26-855f-4b15-9249-6cce3a08f66a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:36.388156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b636c26-855f-4b15-9249-6cce3a08f66a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:36.393283 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e52905-06d2-4b48-b313-10aebc1ab07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:36.393742 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e52905-06d2-4b48-b313-10aebc1ab07e admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:36.394055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e52905-06d2-4b48-b313-10aebc1ab07e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:36.394327 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e52905-06d2-4b48-b313-10aebc1ab07e admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:36.395426 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e52905-06d2-4b48-b313-10aebc1ab07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:36.397246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e52905-06d2-4b48-b313-10aebc1ab07e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:36.479491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331efd622a2746b892acb85e67417e33', 'request_id': 'req-fa7b075d-f3d2-4e07-bc50-869f9de9283a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.490495 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1001/2019] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:36 2021] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:37:36.498295 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e52905-06d2-4b48-b313-10aebc1ab07e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:36.551176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331efd622a2746b892acb85e67417e33', 'request_id': 'req-fa7b075d-f3d2-4e07-bc50-869f9de9283a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.568029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331efd622a2746b892acb85e67417e33', 'request_id': 'req-fa7b075d-f3d2-4e07-bc50-869f9de9283a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.576019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e52905-06d2-4b48-b313-10aebc1ab07e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:36.580923 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797c9d8-0995-4c10-b8ec-d272ea24b770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:36.581601 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797c9d8-0995-4c10-b8ec-d272ea24b770 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:36.581896 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797c9d8-0995-4c10-b8ec-d272ea24b770 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:36.582182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797c9d8-0995-4c10-b8ec-d272ea24b770 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:36.582875 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797c9d8-0995-4c10-b8ec-d272ea24b770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:36.584852 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797c9d8-0995-4c10-b8ec-d272ea24b770 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:36.585637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] The token cache is being invalidate because project 331efd622a2746b892acb85e67417e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:36.585988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.586745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.588544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1019/2020] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:36 2021] DELETE /identity/v3/projects/331efd622a2746b892acb85e67417e33 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:36.593206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:36.598616 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:36.661776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b075d-f3d2-4e07-bc50-869f9de9283a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:36.667158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:36.668067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:36.668350 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:36.668626 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] PATH_INFO: `/v3/users/64466dca813140179dc6ac0366abd057` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:36.669856 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64466dca813140179dc6ac0366abd057)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:36.671842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:36.704213 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1002/2021] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:36 2021] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:36.705204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797c9d8-0995-4c10-b8ec-d272ea24b770 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:36.717492 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e797c9d8-0995-4c10-b8ec-d272ea24b770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:36.732611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797c9d8-0995-4c10-b8ec-d272ea24b770 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:36.737238 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:36.738120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:36.738397 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:36.738670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] PATH_INFO: `/v3/projects/f2d3d1e43396411dadb69f841befc55f` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:36.739855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d3d1e43396411dadb69f841befc55f)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:36.741718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:36.890714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64466dca813140179dc6ac0366abd057'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.890949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d3d1e43396411dadb69f841befc55f', 'request_id': 'req-d5a53194-9462-4e1a-9600-576bd568e91b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.891504 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64466dca813140179dc6ac0366abd057'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.892161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64466dca813140179dc6ac0366abd057'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.964573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d3d1e43396411dadb69f841befc55f', 'request_id': 'req-d5a53194-9462-4e1a-9600-576bd568e91b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.970504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d3d1e43396411dadb69f841befc55f', 'request_id': 'req-d5a53194-9462-4e1a-9600-576bd568e91b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.983462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] The token cache is being invalidate because project f2d3d1e43396411dadb69f841befc55f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:36.983748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.984417 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:36.986000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1003/2022] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:36 2021] DELETE /identity/v3/projects/f2d3d1e43396411dadb69f841befc55f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:36.987034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:36.988359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:37.042451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64466dca813140179dc6ac0366abd057'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:37.053119 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a53194-9462-4e1a-9600-576bd568e91b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:37.058498 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64466dca813140179dc6ac0366abd057'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:37.064214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced389d2-c696-4584-8f1b-bba3dca6d36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:37.065000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced389d2-c696-4584-8f1b-bba3dca6d36f admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:37.065279 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced389d2-c696-4584-8f1b-bba3dca6d36f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:37.065734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced389d2-c696-4584-8f1b-bba3dca6d36f admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:37.066527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced389d2-c696-4584-8f1b-bba3dca6d36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:37.068208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced389d2-c696-4584-8f1b-bba3dca6d36f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:37.079553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1004/2024] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:36 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:37.083099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced389d2-c696-4584-8f1b-bba3dca6d36f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:37.083211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1020/2024] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:36 2021] DELETE /identity/v3/users/64466dca813140179dc6ac0366abd057 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:37.084278 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:37.084431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ced389d2-c696-4584-8f1b-bba3dca6d36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:37.094818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:37.097616 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced389d2-c696-4584-8f1b-bba3dca6d36f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:37.170356 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:37.173091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:37.173091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:37.173091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] PATH_INFO: `/v3/users/e401d3c069d54c0dac70e4518e8f4928` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:37.173091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e401d3c069d54c0dac70e4518e8f4928)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:37.175013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:37.183318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f71918-8fa0-4842-a02f-f6f6fa2569f3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:37.193537 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3138b65-794b-4ede-99b5-bfa6e9bd0967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:37.194181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3138b65-794b-4ede-99b5-bfa6e9bd0967 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:37.194472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3138b65-794b-4ede-99b5-bfa6e9bd0967 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:37.194754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3138b65-794b-4ede-99b5-bfa6e9bd0967 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:37.195496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3138b65-794b-4ede-99b5-bfa6e9bd0967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:37.198312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3138b65-794b-4ede-99b5-bfa6e9bd0967 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:37.208832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1021/2025] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:37 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:37.213477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3138b65-794b-4ede-99b5-bfa6e9bd0967 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:37.223706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3138b65-794b-4ede-99b5-bfa6e9bd0967 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:37.229308 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52865cf-57b5-4c6e-95e6-6cd978986ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:37.230362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52865cf-57b5-4c6e-95e6-6cd978986ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:37.230538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52865cf-57b5-4c6e-95e6-6cd978986ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:37.230812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52865cf-57b5-4c6e-95e6-6cd978986ae0 admin admin] PATH_INFO: `/v3/projects/aa7ec9d6df484e65aeebed1136124ab1/users/50a14af18b364503819681d7a8ff49e1/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:37.248138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52865cf-57b5-4c6e-95e6-6cd978986ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7ec9d6df484e65aeebed1136124ab1, user_id=50a14af18b364503819681d7a8ff49e1, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:37.250929 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52865cf-57b5-4c6e-95e6-6cd978986ae0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:37.340319 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1022/2026] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:37 2021] PUT /identity/v3/projects/aa7ec9d6df484e65aeebed1136124ab1/users/50a14af18b364503819681d7a8ff49e1/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:37.356834 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98075ae-0273-4186-ae5b-0fd78f0dc81d None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:37.356834 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98075ae-0273-4186-ae5b-0fd78f0dc81d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:37.356834 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98075ae-0273-4186-ae5b-0fd78f0dc81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:37.385931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-f98075ae-0273-4186-ae5b-0fd78f0dc81d None None] MFA Rules not processed for user `50a14af18b364503819681d7a8ff49e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:37.387861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f98075ae-0273-4186-ae5b-0fd78f0dc81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:37.395501 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e401d3c069d54c0dac70e4518e8f4928'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:37.396437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e401d3c069d54c0dac70e4518e8f4928'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:37.409478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e401d3c069d54c0dac70e4518e8f4928'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:37.522552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e401d3c069d54c0dac70e4518e8f4928'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:37.541570 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e401d3c069d54c0dac70e4518e8f4928'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:37.547972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1005/2027] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:37 2021] DELETE /identity/v3/users/e401d3c069d54c0dac70e4518e8f4928 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:37.573532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:37.574995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:37.585482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1023/2028] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:37 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:37.596088 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98075ae-0273-4186-ae5b-0fd78f0dc81d None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:37.598046 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f98075ae-0273-4186-ae5b-0fd78f0dc81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:37.672943 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71eb973-4b7c-475a-a2ba-fed317b83569 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:37.679726 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:37.680967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:37.681777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:37.682304 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] PATH_INFO: `/v3/projects/d0542256f5c643c5868b32d0991c1071` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:37.683743 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0542256f5c643c5868b32d0991c1071)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:37.685965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:37.695765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98075ae-0273-4186-ae5b-0fd78f0dc81d None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:37.701919 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67b07c-145e-4c05-96c7-b93b1d127e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:37.702600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67b07c-145e-4c05-96c7-b93b1d127e89 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:37.702887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67b07c-145e-4c05-96c7-b93b1d127e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:37.703162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67b07c-145e-4c05-96c7-b93b1d127e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:37.703872 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67b07c-145e-4c05-96c7-b93b1d127e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:37.705772 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67b07c-145e-4c05-96c7-b93b1d127e89 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:37.834157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1024/2029] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:37 2021] POST /identity/v3/projects => generated 375 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:37:37.847040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67b07c-145e-4c05-96c7-b93b1d127e89 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:37.862535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0542256f5c643c5868b32d0991c1071', 'request_id': 'req-c788dd89-cfec-4455-8971-98add9e3eb5f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:37.933952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67b07c-145e-4c05-96c7-b93b1d127e89 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:37.938865 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024e063-ba1e-432c-9fc2-a0a20d97710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:37.939530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024e063-ba1e-432c-9fc2-a0a20d97710a admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:37.939809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024e063-ba1e-432c-9fc2-a0a20d97710a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:37.940096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024e063-ba1e-432c-9fc2-a0a20d97710a admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:37.940780 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024e063-ba1e-432c-9fc2-a0a20d97710a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:37.942790 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024e063-ba1e-432c-9fc2-a0a20d97710a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:37.943699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0542256f5c643c5868b32d0991c1071', 'request_id': 'req-c788dd89-cfec-4455-8971-98add9e3eb5f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:37.951677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0542256f5c643c5868b32d0991c1071', 'request_id': 'req-c788dd89-cfec-4455-8971-98add9e3eb5f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:37.965819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] The token cache is being invalidate because project d0542256f5c643c5868b32d0991c1071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:37.966283 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:37.967075 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:37.969908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1006/2030] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:37 2021] DELETE /identity/v3/projects/d0542256f5c643c5868b32d0991c1071 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:38.073832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1025/2031] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:37 2021] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:38.077999 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:38.079465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:38.142881 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024e063-ba1e-432c-9fc2-a0a20d97710a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:38.149031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0024e063-ba1e-432c-9fc2-a0a20d97710a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:38.153919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788dd89-cfec-4455-8971-98add9e3eb5f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:38.158979 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024e063-ba1e-432c-9fc2-a0a20d97710a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:38.163809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:38.164662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:38.164943 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:38.165217 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] PATH_INFO: `/v3/projects/cbe96f3b7a464859b0fd55ee46e44edd` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:38.166582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe96f3b7a464859b0fd55ee46e44edd)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:38.168476 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:38.168604 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e168563-aa59-488f-b00c-ca983842660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:38.169253 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e168563-aa59-488f-b00c-ca983842660b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:38.169549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e168563-aa59-488f-b00c-ca983842660b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:38.169889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e168563-aa59-488f-b00c-ca983842660b admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:38.170613 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e168563-aa59-488f-b00c-ca983842660b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:38.172229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e168563-aa59-488f-b00c-ca983842660b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:38.182294 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1007/2032] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:38 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:38.186527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e168563-aa59-488f-b00c-ca983842660b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:38.196221 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e168563-aa59-488f-b00c-ca983842660b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:38.203660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65ede7-0b5a-4e3e-8f6f-d00e81077813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:38.204874 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65ede7-0b5a-4e3e-8f6f-d00e81077813 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:38.205203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65ede7-0b5a-4e3e-8f6f-d00e81077813 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:38.205686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65ede7-0b5a-4e3e-8f6f-d00e81077813 admin admin] PATH_INFO: `/v3/projects/d9c0f16e46b44da2af72596b06ea2805/users/82f9385ff741438696ab0e5204712b19/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:38.222682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65ede7-0b5a-4e3e-8f6f-d00e81077813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c0f16e46b44da2af72596b06ea2805, user_id=82f9385ff741438696ab0e5204712b19, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:38.225296 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65ede7-0b5a-4e3e-8f6f-d00e81077813 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:38.314910 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1008/2033] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:38 2021] PUT /identity/v3/projects/d9c0f16e46b44da2af72596b06ea2805/users/82f9385ff741438696ab0e5204712b19/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:38.318463 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65ede7-0b5a-4e3e-8f6f-d00e81077813 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:38.322915 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe96f3b7a464859b0fd55ee46e44edd', 'request_id': 'req-a53114d9-a04b-402c-a41e-ef1475a173cf'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:38.378904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65ede7-0b5a-4e3e-8f6f-d00e81077813 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:38.394491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe96f3b7a464859b0fd55ee46e44edd', 'request_id': 'req-a53114d9-a04b-402c-a41e-ef1475a173cf'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:38.402459 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe96f3b7a464859b0fd55ee46e44edd', 'request_id': 'req-a53114d9-a04b-402c-a41e-ef1475a173cf'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:38.417588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] The token cache is being invalidate because project cbe96f3b7a464859b0fd55ee46e44edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:38.417890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:38.418554 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:38.420077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1026/2034] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:38 2021] DELETE /identity/v3/projects/cbe96f3b7a464859b0fd55ee46e44edd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:38.423873 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:38.425277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:38.444549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29c3eb-c677-4b4e-995d-7515ea7314ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:38.445238 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29c3eb-c677-4b4e-995d-7515ea7314ab admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:38.445513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29c3eb-c677-4b4e-995d-7515ea7314ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:38.445783 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29c3eb-c677-4b4e-995d-7515ea7314ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:38.446551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29c3eb-c677-4b4e-995d-7515ea7314ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:38.448231 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29c3eb-c677-4b4e-995d-7515ea7314ab admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:38.457794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1009/2035] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:38 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:37:38.461826 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29c3eb-c677-4b4e-995d-7515ea7314ab admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:38.464291 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0f29c3eb-c677-4b4e-995d-7515ea7314ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:38.478495 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29c3eb-c677-4b4e-995d-7515ea7314ab admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:38.484933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe67904-751a-4cdf-97da-a46f2887442d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:38.485816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe67904-751a-4cdf-97da-a46f2887442d admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:38.486124 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe67904-751a-4cdf-97da-a46f2887442d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:38.486395 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe67904-751a-4cdf-97da-a46f2887442d admin admin] PATH_INFO: `/v3/projects/d9c0f16e46b44da2af72596b06ea2805/users/82f9385ff741438696ab0e5204712b19/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:38.488374 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe67904-751a-4cdf-97da-a46f2887442d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c0f16e46b44da2af72596b06ea2805, user_id=82f9385ff741438696ab0e5204712b19, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:38.491054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53114d9-a04b-402c-a41e-ef1475a173cf admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:38.491196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe67904-751a-4cdf-97da-a46f2887442d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:38.495769 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd5661-a531-4c9c-b4f9-82192ef879d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:38.496646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd5661-a531-4c9c-b4f9-82192ef879d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:38.496904 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd5661-a531-4c9c-b4f9-82192ef879d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:38.497174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd5661-a531-4c9c-b4f9-82192ef879d1 admin admin] PATH_INFO: `/v3/users/4e8ad07195c44e81bc6fd7024744e235` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:38.498437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd5661-a531-4c9c-b4f9-82192ef879d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8ad07195c44e81bc6fd7024744e235)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:38.500311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd5661-a531-4c9c-b4f9-82192ef879d1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:38.501825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1010/2036] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:38 2021] PUT /identity/v3/projects/d9c0f16e46b44da2af72596b06ea2805/users/82f9385ff741438696ab0e5204712b19/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:38.511840 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ac768-a7e8-425b-8752-57838ad5ec3e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:38.512123 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ac768-a7e8-425b-8752-57838ad5ec3e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:38.512394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ac768-a7e8-425b-8752-57838ad5ec3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:38.546539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-909ac768-a7e8-425b-8752-57838ad5ec3e None None] MFA Rules not processed for user `82f9385ff741438696ab0e5204712b19`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:38.547776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-909ac768-a7e8-425b-8752-57838ad5ec3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:38.616119 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1011/2037] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:38 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:38.626211 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ac768-a7e8-425b-8752-57838ad5ec3e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:38.627505 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-909ac768-a7e8-425b-8752-57838ad5ec3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:38.684052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ac768-a7e8-425b-8752-57838ad5ec3e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:38.687719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627aaa52-8766-42ba-ba78-04c80311f1d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:38.688356 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aaa52-8766-42ba-ba78-04c80311f1d5 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:38.688633 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aaa52-8766-42ba-ba78-04c80311f1d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:38.688901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aaa52-8766-42ba-ba78-04c80311f1d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:38.690702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-627aaa52-8766-42ba-ba78-04c80311f1d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:38.712761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-22fd5661-a531-4c9c-b4f9-82192ef879d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8ad07195c44e81bc6fd7024744e235'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:38.713441 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-22fd5661-a531-4c9c-b4f9-82192ef879d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8ad07195c44e81bc6fd7024744e235'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:38.714117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-22fd5661-a531-4c9c-b4f9-82192ef879d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8ad07195c44e81bc6fd7024744e235'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:38.750605 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627aaa52-8766-42ba-ba78-04c80311f1d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:38.752022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627aaa52-8766-42ba-ba78-04c80311f1d5 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:38.760826 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1012/2038] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:38 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:37:38.780498 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-22fd5661-a531-4c9c-b4f9-82192ef879d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8ad07195c44e81bc6fd7024744e235'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:38.794619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-22fd5661-a531-4c9c-b4f9-82192ef879d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8ad07195c44e81bc6fd7024744e235'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:38.808827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1027/2039] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:38 2021] DELETE /identity/v3/users/4e8ad07195c44e81bc6fd7024744e235 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:39.351150 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627aaa52-8766-42ba-ba78-04c80311f1d5 service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:39.414164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627aaa52-8766-42ba-ba78-04c80311f1d5 service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:39.468040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc68061-5604-4509-b782-b32276d5d262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:39.468820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc68061-5604-4509-b782-b32276d5d262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:39.469097 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc68061-5604-4509-b782-b32276d5d262 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:39.469370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc68061-5604-4509-b782-b32276d5d262 admin admin] PATH_INFO: `/v3/projects/2fd49238eb374b1787e877a69cd1d3e2` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:39.470608 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc68061-5604-4509-b782-b32276d5d262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd49238eb374b1787e877a69cd1d3e2)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:39.472767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc68061-5604-4509-b782-b32276d5d262 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:39.685109 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ccc68061-5604-4509-b782-b32276d5d262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd49238eb374b1787e877a69cd1d3e2', 'request_id': 'req-ccc68061-5604-4509-b782-b32276d5d262'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:39.800390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ccc68061-5604-4509-b782-b32276d5d262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd49238eb374b1787e877a69cd1d3e2', 'request_id': 'req-ccc68061-5604-4509-b782-b32276d5d262'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:39.807587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ccc68061-5604-4509-b782-b32276d5d262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd49238eb374b1787e877a69cd1d3e2', 'request_id': 'req-ccc68061-5604-4509-b782-b32276d5d262'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:39.818612 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ccc68061-5604-4509-b782-b32276d5d262 admin admin] The token cache is being invalidate because project 2fd49238eb374b1787e877a69cd1d3e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:39.822594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ccc68061-5604-4509-b782-b32276d5d262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:39.822594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ccc68061-5604-4509-b782-b32276d5d262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:39.822594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1013/2040] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:39 2021] DELETE /identity/v3/projects/2fd49238eb374b1787e877a69cd1d3e2 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:39.832030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bbb3c-7724-45f3-9e4e-505a6fbe289c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:39.832030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bbb3c-7724-45f3-9e4e-505a6fbe289c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:39.832030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bbb3c-7724-45f3-9e4e-505a6fbe289c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:39.851252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-ad3bbb3c-7724-45f3-9e4e-505a6fbe289c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:39.852472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ad3bbb3c-7724-45f3-9e4e-505a6fbe289c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:39.911671 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1028/2041] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:39.921126 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f7c93-acfd-4a08-adfb-813c598ae2ea None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:39.921780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f7c93-acfd-4a08-adfb-813c598ae2ea None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:39.922193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f7c93-acfd-4a08-adfb-813c598ae2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:39.940693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-d45f7c93-acfd-4a08-adfb-813c598ae2ea None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:39.942047 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d45f7c93-acfd-4a08-adfb-813c598ae2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:39.950252 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1014/2042] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:39.954565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bbb3c-7724-45f3-9e4e-505a6fbe289c None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:39.966714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bbb3c-7724-45f3-9e4e-505a6fbe289c None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:39.971903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180561b-c69a-48e1-94d1-76e915b8615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:39.972878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180561b-c69a-48e1-94d1-76e915b8615a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:39.973158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180561b-c69a-48e1-94d1-76e915b8615a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:39.973428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180561b-c69a-48e1-94d1-76e915b8615a admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:39.975428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180561b-c69a-48e1-94d1-76e915b8615a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:37:39.975428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180561b-c69a-48e1-94d1-76e915b8615a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:39.977547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180561b-c69a-48e1-94d1-76e915b8615a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:39.995684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1029/2043] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:37:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:37:39.997261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f7c93-acfd-4a08-adfb-813c598ae2ea None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:40.006744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f7c93-acfd-4a08-adfb-813c598ae2ea None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:40.012423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93024-94e7-4afc-bcbe-feca040c8dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:40.013163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93024-94e7-4afc-bcbe-feca040c8dde admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:40.013513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93024-94e7-4afc-bcbe-feca040c8dde admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:40.013876 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93024-94e7-4afc-bcbe-feca040c8dde admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:40.014691 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd93024-94e7-4afc-bcbe-feca040c8dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:40.016663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd93024-94e7-4afc-bcbe-feca040c8dde admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:40.099315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1015/2044] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:39 2021] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:40.103390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180561b-c69a-48e1-94d1-76e915b8615a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:40.113026 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180561b-c69a-48e1-94d1-76e915b8615a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:40.167096 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca0ce2-7d3b-45e0-9e2d-4d6886d527ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:40.167764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca0ce2-7d3b-45e0-9e2d-4d6886d527ff admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:40.168041 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca0ce2-7d3b-45e0-9e2d-4d6886d527ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:40.168313 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca0ce2-7d3b-45e0-9e2d-4d6886d527ff admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:40.168996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca0ce2-7d3b-45e0-9e2d-4d6886d527ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:40.170926 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca0ce2-7d3b-45e0-9e2d-4d6886d527ff admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:40.249727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1030/2045] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:40 2021] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:40.253431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93024-94e7-4afc-bcbe-feca040c8dde admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:40.263915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93024-94e7-4afc-bcbe-feca040c8dde admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:40.268550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe8450-e17e-4cfb-a930-296731ad360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:40.269248 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8450-e17e-4cfb-a930-296731ad360e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:40.269575 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8450-e17e-4cfb-a930-296731ad360e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:40.269851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8450-e17e-4cfb-a930-296731ad360e admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:40.270604 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe8450-e17e-4cfb-a930-296731ad360e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:40.272172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe8450-e17e-4cfb-a930-296731ad360e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:40.282779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1016/2046] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:40.286936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca0ce2-7d3b-45e0-9e2d-4d6886d527ff admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:40.298880 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca0ce2-7d3b-45e0-9e2d-4d6886d527ff admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:40.303490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4486c1-08f0-46d3-98b7-d6890a6a8689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:40.304202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4486c1-08f0-46d3-98b7-d6890a6a8689 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:40.304488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4486c1-08f0-46d3-98b7-d6890a6a8689 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:40.304783 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4486c1-08f0-46d3-98b7-d6890a6a8689 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:40.305483 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4486c1-08f0-46d3-98b7-d6890a6a8689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:40.308038 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4486c1-08f0-46d3-98b7-d6890a6a8689 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:40.318603 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1031/2047] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:40 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:40.329249 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe8450-e17e-4cfb-a930-296731ad360e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:40.339510 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe8450-e17e-4cfb-a930-296731ad360e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:40.344200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b795e8c-43f8-48f5-8ca6-3cc9919a0c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:40.345080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b795e8c-43f8-48f5-8ca6-3cc9919a0c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:40.345376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b795e8c-43f8-48f5-8ca6-3cc9919a0c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:40.345759 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b795e8c-43f8-48f5-8ca6-3cc9919a0c22 admin admin] PATH_INFO: `/v3/projects/6c259659aa644d5d8f2591e4158c1dba/users/7865f77162aa4c6ebf0edaf301c8a88f/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:40.361091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b795e8c-43f8-48f5-8ca6-3cc9919a0c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c259659aa644d5d8f2591e4158c1dba, user_id=7865f77162aa4c6ebf0edaf301c8a88f, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:40.366210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b795e8c-43f8-48f5-8ca6-3cc9919a0c22 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:40.460081 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1017/2048] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:40 2021] PUT /identity/v3/projects/6c259659aa644d5d8f2591e4158c1dba/users/7865f77162aa4c6ebf0edaf301c8a88f/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:40.472662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842bd50-c384-4d7e-b16a-8f879ce75a45 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:40.472955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842bd50-c384-4d7e-b16a-8f879ce75a45 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:40.473229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842bd50-c384-4d7e-b16a-8f879ce75a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:40.500936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-f842bd50-c384-4d7e-b16a-8f879ce75a45 None None] MFA Rules not processed for user `7865f77162aa4c6ebf0edaf301c8a88f`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:40.502168 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f842bd50-c384-4d7e-b16a-8f879ce75a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:40.566068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1032/2049] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:40 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:40.578668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b795e8c-43f8-48f5-8ca6-3cc9919a0c22 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:40.580391 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-2b795e8c-43f8-48f5-8ca6-3cc9919a0c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:40.637663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b795e8c-43f8-48f5-8ca6-3cc9919a0c22 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:40.641314 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65d49d-72f6-4824-8c9d-fc660a9eb302 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db83070471e34df695b571cdab440b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:40.641989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65d49d-72f6-4824-8c9d-fc660a9eb302 service glance] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:40.642268 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65d49d-72f6-4824-8c9d-fc660a9eb302 service glance] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:40.642540 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65d49d-72f6-4824-8c9d-fc660a9eb302 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:40.652725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65d49d-72f6-4824-8c9d-fc660a9eb302 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:40.654365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65d49d-72f6-4824-8c9d-fc660a9eb302 service glance] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:40.663871 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1018/2050] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:40 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:37:41.941468 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842bd50-c384-4d7e-b16a-8f879ce75a45 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:41.942943 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f842bd50-c384-4d7e-b16a-8f879ce75a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:42.023889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842bd50-c384-4d7e-b16a-8f879ce75a45 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:42.029035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:42.029941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:42.030358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:42.030632 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] PATH_INFO: `/v3/users/50a14af18b364503819681d7a8ff49e1` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:42.032157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a14af18b364503819681d7a8ff49e1)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:42.034106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:42.275392 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a14af18b364503819681d7a8ff49e1'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:42.276063 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a14af18b364503819681d7a8ff49e1'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:42.276680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a14af18b364503819681d7a8ff49e1'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:42.328328 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a14af18b364503819681d7a8ff49e1'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:42.340946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a14af18b364503819681d7a8ff49e1'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:42.353552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1033/2051] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:41 2021] DELETE /identity/v3/users/50a14af18b364503819681d7a8ff49e1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:42.358291 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24ea8c-2efd-4e74-a783-d81e74708d1d None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:42.358674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24ea8c-2efd-4e74-a783-d81e74708d1d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:42.358973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24ea8c-2efd-4e74-a783-d81e74708d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:42.380911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-3a24ea8c-2efd-4e74-a783-d81e74708d1d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:42.382421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-3a24ea8c-2efd-4e74-a783-d81e74708d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:42.448755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1019/2052] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:42.459235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:42.460712 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:42.521265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80f01e-61b2-46e7-a1a9-a8c449aeb46f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:42.524825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc5460-8d3c-4e44-88c9-c6778e69cefb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:42.525458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5460-8d3c-4e44-88c9-c6778e69cefb service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:42.525734 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5460-8d3c-4e44-88c9-c6778e69cefb service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:42.526036 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5460-8d3c-4e44-88c9-c6778e69cefb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:42.534584 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc5460-8d3c-4e44-88c9-c6778e69cefb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:42.535995 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc5460-8d3c-4e44-88c9-c6778e69cefb service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:42.546044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1034/2053] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:37:43.009988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24ea8c-2efd-4e74-a783-d81e74708d1d None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:43.011447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-3a24ea8c-2efd-4e74-a783-d81e74708d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:43.029671 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24ea8c-2efd-4e74-a783-d81e74708d1d None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:43.034770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:43.035628 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:43.035905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:43.036172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] PATH_INFO: `/v3/projects/aa7ec9d6df484e65aeebed1136124ab1` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:43.037332 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7ec9d6df484e65aeebed1136124ab1)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:43.039348 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:43.190648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7ec9d6df484e65aeebed1136124ab1', 'request_id': 'req-64ad8046-b933-48fd-9e55-469e446c468d'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:43.257200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7ec9d6df484e65aeebed1136124ab1', 'request_id': 'req-64ad8046-b933-48fd-9e55-469e446c468d'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:43.265263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7ec9d6df484e65aeebed1136124ab1', 'request_id': 'req-64ad8046-b933-48fd-9e55-469e446c468d'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:43.276816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] The token cache is being invalidate because project aa7ec9d6df484e65aeebed1136124ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:43.277111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:43.277819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:43.284690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1020/2054] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:43 2021] DELETE /identity/v3/projects/aa7ec9d6df484e65aeebed1136124ab1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:43.287467 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc5460-8d3c-4e44-88c9-c6778e69cefb service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:43.298199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc5460-8d3c-4e44-88c9-c6778e69cefb service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:43.351934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8dd7b-54f4-4285-84df-34a4d8d6e521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:43.353340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8dd7b-54f4-4285-84df-34a4d8d6e521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:43.353642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8dd7b-54f4-4285-84df-34a4d8d6e521 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:43.353952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8dd7b-54f4-4285-84df-34a4d8d6e521 admin admin] PATH_INFO: `/v3/users/82f9385ff741438696ab0e5204712b19` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:43.355146 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8dd7b-54f4-4285-84df-34a4d8d6e521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f9385ff741438696ab0e5204712b19)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:43.357047 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8dd7b-54f4-4285-84df-34a4d8d6e521 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:43.539407 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7dc8dd7b-54f4-4285-84df-34a4d8d6e521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f9385ff741438696ab0e5204712b19'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:43.540054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7dc8dd7b-54f4-4285-84df-34a4d8d6e521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f9385ff741438696ab0e5204712b19'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:43.542300 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7dc8dd7b-54f4-4285-84df-34a4d8d6e521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f9385ff741438696ab0e5204712b19'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:43.622878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7dc8dd7b-54f4-4285-84df-34a4d8d6e521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f9385ff741438696ab0e5204712b19'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:43.636053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7dc8dd7b-54f4-4285-84df-34a4d8d6e521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f9385ff741438696ab0e5204712b19'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:43.647855 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1035/2055] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:37:43 2021] DELETE /identity/v3/users/82f9385ff741438696ab0e5204712b19 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:44.142644 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:44.144302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:44.169886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad8046-b933-48fd-9e55-469e446c468d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:44.228254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:44.229109 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:44.229388 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:44.229660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa admin admin] PATH_INFO: `/v3/projects/d9c0f16e46b44da2af72596b06ea2805` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:44.230893 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c0f16e46b44da2af72596b06ea2805)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:44.233249 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:44.365375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c0f16e46b44da2af72596b06ea2805', 'request_id': 'req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:44.434589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c0f16e46b44da2af72596b06ea2805', 'request_id': 'req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:44.440239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c0f16e46b44da2af72596b06ea2805', 'request_id': 'req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:44.453661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa admin admin] The token cache is being invalidate because project d9c0f16e46b44da2af72596b06ea2805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:37:44.453988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:44.455646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f414e0c4-9fc8-4590-b6f7-8e605b2453aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:37:44.456444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1021/2056] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:37:44 2021] DELETE /identity/v3/projects/d9c0f16e46b44da2af72596b06ea2805 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:37:44.462403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369323b7-2172-4558-9c57-71deab0ceab9 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:44.462864 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369323b7-2172-4558-9c57-71deab0ceab9 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:44.463116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369323b7-2172-4558-9c57-71deab0ceab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:44.481319 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-369323b7-2172-4558-9c57-71deab0ceab9 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:44.482541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-369323b7-2172-4558-9c57-71deab0ceab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:44.543499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1036/2057] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:37:44.551554 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3deba9-84b8-46f0-a2aa-712c595748a7 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:44.551846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3deba9-84b8-46f0-a2aa-712c595748a7 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:44.552127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3deba9-84b8-46f0-a2aa-712c595748a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:44.570494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-8d3deba9-84b8-46f0-a2aa-712c595748a7 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:44.572273 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8d3deba9-84b8-46f0-a2aa-712c595748a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:44.580011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1022/2058] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:44.584289 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369323b7-2172-4558-9c57-71deab0ceab9 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:44.594422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369323b7-2172-4558-9c57-71deab0ceab9 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:44.599566 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee93b9-c1e8-4a65-86bd-84c64cff036c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:44.600252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee93b9-c1e8-4a65-86bd-84c64cff036c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:44.600532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee93b9-c1e8-4a65-86bd-84c64cff036c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:44.600845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee93b9-c1e8-4a65-86bd-84c64cff036c admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:44.601603 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee93b9-c1e8-4a65-86bd-84c64cff036c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:37:44.601810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee93b9-c1e8-4a65-86bd-84c64cff036c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:44.603658 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee93b9-c1e8-4a65-86bd-84c64cff036c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:44.619216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1037/2059] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:37:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:37:44.620730 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3deba9-84b8-46f0-a2aa-712c595748a7 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:44.630082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3deba9-84b8-46f0-a2aa-712c595748a7 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:44.635344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af7710-d104-4858-a8a4-adc6464e5735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:44.636138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af7710-d104-4858-a8a4-adc6464e5735 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:44.636454 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af7710-d104-4858-a8a4-adc6464e5735 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:44.636725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af7710-d104-4858-a8a4-adc6464e5735 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:44.637411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af7710-d104-4858-a8a4-adc6464e5735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:44.639321 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af7710-d104-4858-a8a4-adc6464e5735 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:44.745282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1023/2060] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:37:44 2021] POST /identity/v3/projects => generated 363 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:37:44.749332 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee93b9-c1e8-4a65-86bd-84c64cff036c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:44.759395 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee93b9-c1e8-4a65-86bd-84c64cff036c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:44.817953 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0779d-692d-4557-97da-caf6b59d9f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:44.818629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0779d-692d-4557-97da-caf6b59d9f79 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:44.818914 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0779d-692d-4557-97da-caf6b59d9f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:44.819193 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0779d-692d-4557-97da-caf6b59d9f79 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:44.819872 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0779d-692d-4557-97da-caf6b59d9f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:44.822243 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0779d-692d-4557-97da-caf6b59d9f79 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:44.894555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1038/2061] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:37:44 2021] POST /identity/v3/users => generated 282 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:37:44.898539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af7710-d104-4858-a8a4-adc6464e5735 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:44.909199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af7710-d104-4858-a8a4-adc6464e5735 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:44.913852 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfb018-c7c1-4760-bed2-ac16a84d79a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:44.914541 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfb018-c7c1-4760-bed2-ac16a84d79a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:44.914863 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfb018-c7c1-4760-bed2-ac16a84d79a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:44.915131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfb018-c7c1-4760-bed2-ac16a84d79a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:44.916509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfb018-c7c1-4760-bed2-ac16a84d79a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:44.918106 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfb018-c7c1-4760-bed2-ac16a84d79a1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:44.928354 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1024/2062] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:44.933110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0779d-692d-4557-97da-caf6b59d9f79 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:44.942827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0779d-692d-4557-97da-caf6b59d9f79 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:44.947635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db0eb6-89cb-4013-830b-94fb9c146145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:44.948280 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db0eb6-89cb-4013-830b-94fb9c146145 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:44.948556 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db0eb6-89cb-4013-830b-94fb9c146145 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:44.948825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db0eb6-89cb-4013-830b-94fb9c146145 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:44.949538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db0eb6-89cb-4013-830b-94fb9c146145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:44.951153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db0eb6-89cb-4013-830b-94fb9c146145 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:44.962909 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1039/2063] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:37:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:37:44.967020 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfb018-c7c1-4760-bed2-ac16a84d79a1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:44.977059 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfb018-c7c1-4760-bed2-ac16a84d79a1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:44.982381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba91b2-62b2-4a2a-982a-35ea3b1ff1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:44.983271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba91b2-62b2-4a2a-982a-35ea3b1ff1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:44.983552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba91b2-62b2-4a2a-982a-35ea3b1ff1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:44.983855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba91b2-62b2-4a2a-982a-35ea3b1ff1d2 admin admin] PATH_INFO: `/v3/projects/9ef27dea6c3e4679b973388f5c11576b/users/ebd758eb72054b56ae212c6d1475c93a/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:44.998550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba91b2-62b2-4a2a-982a-35ea3b1ff1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef27dea6c3e4679b973388f5c11576b, user_id=ebd758eb72054b56ae212c6d1475c93a, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:45.001162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba91b2-62b2-4a2a-982a-35ea3b1ff1d2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:45.103462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1025/2064] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:37:44 2021] PUT /identity/v3/projects/9ef27dea6c3e4679b973388f5c11576b/users/ebd758eb72054b56ae212c6d1475c93a/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:37:45.117485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3101c4e-58da-49f4-96c0-3c2a5024b9f5 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:45.117816 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3101c4e-58da-49f4-96c0-3c2a5024b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:45.118134 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3101c4e-58da-49f4-96c0-3c2a5024b9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:45.150627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d3101c4e-58da-49f4-96c0-3c2a5024b9f5 None None] MFA Rules not processed for user `ebd758eb72054b56ae212c6d1475c93a`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:37:45.150627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d3101c4e-58da-49f4-96c0-3c2a5024b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:45.219593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1040/2065] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:37:45 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:37:45.230950 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba91b2-62b2-4a2a-982a-35ea3b1ff1d2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:37:45.232731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-86ba91b2-62b2-4a2a-982a-35ea3b1ff1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:37:45.314680 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba91b2-62b2-4a2a-982a-35ea3b1ff1d2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:37:45.318416 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99d009-7097-4433-9612-8d6f47e5b6d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:37:45.319054 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99d009-7097-4433-9612-8d6f47e5b6d2 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:37:45.319335 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99d009-7097-4433-9612-8d6f47e5b6d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:37:45.319610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99d009-7097-4433-9612-8d6f47e5b6d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:37:45.329320 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99d009-7097-4433-9612-8d6f47e5b6d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:37:45.330868 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99d009-7097-4433-9612-8d6f47e5b6d2 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:37:45.341634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1026/2066] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:37:45 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:38:15.382090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3101c4e-58da-49f4-96c0-3c2a5024b9f5 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:15.383515 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d3101c4e-58da-49f4-96c0-3c2a5024b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:15.448180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3101c4e-58da-49f4-96c0-3c2a5024b9f5 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:15.452660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:15.453570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:15.453847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:15.454157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] PATH_INFO: `/v3/users/5720a71e2a5a4332be8bdc32036515e8` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:15.455357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5720a71e2a5a4332be8bdc32036515e8)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:15.457266 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:15.710388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5720a71e2a5a4332be8bdc32036515e8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:15.710388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5720a71e2a5a4332be8bdc32036515e8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:15.710388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5720a71e2a5a4332be8bdc32036515e8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:15.786548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5720a71e2a5a4332be8bdc32036515e8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:15.800803 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5720a71e2a5a4332be8bdc32036515e8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:15.828597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1041/2067] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:38:15 2021] DELETE /identity/v3/users/5720a71e2a5a4332be8bdc32036515e8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:15.828910 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e977470-81e1-452e-97c5-dbf90ce370a4 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:15.828910 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e977470-81e1-452e-97c5-dbf90ce370a4 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:15.828910 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e977470-81e1-452e-97c5-dbf90ce370a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:15.860324 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-7e977470-81e1-452e-97c5-dbf90ce370a4 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:15.861638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7e977470-81e1-452e-97c5-dbf90ce370a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:15.941069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1027/2068] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:15.951100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:15.952599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:16.015475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9deec-a746-4983-9e4d-ac84e788d246 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:16.020164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a9eb5-13fd-45e3-ad46-cd2117ecd21c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:16.020884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a9eb5-13fd-45e3-ad46-cd2117ecd21c service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:16.021196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a9eb5-13fd-45e3-ad46-cd2117ecd21c service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:16.021471 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a9eb5-13fd-45e3-ad46-cd2117ecd21c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:16.031081 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a9eb5-13fd-45e3-ad46-cd2117ecd21c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:16.033340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a9eb5-13fd-45e3-ad46-cd2117ecd21c service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:16.045314 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1042/2069] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:38:16.537819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e977470-81e1-452e-97c5-dbf90ce370a4 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:16.539769 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7e977470-81e1-452e-97c5-dbf90ce370a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:16.556513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e977470-81e1-452e-97c5-dbf90ce370a4 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:16.562677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc51054-2c64-4599-bd4f-49d6f1a8166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:16.564971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc51054-2c64-4599-bd4f-49d6f1a8166e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:16.565439 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc51054-2c64-4599-bd4f-49d6f1a8166e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:16.566050 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc51054-2c64-4599-bd4f-49d6f1a8166e admin admin] PATH_INFO: `/v3/projects/0dd75f7e4d024fc0904348990b9e3863` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:16.569470 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc51054-2c64-4599-bd4f-49d6f1a8166e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd75f7e4d024fc0904348990b9e3863)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:16.581200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc51054-2c64-4599-bd4f-49d6f1a8166e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:16.689909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ddc51054-2c64-4599-bd4f-49d6f1a8166e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd75f7e4d024fc0904348990b9e3863', 'request_id': 'req-ddc51054-2c64-4599-bd4f-49d6f1a8166e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:16.763282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ddc51054-2c64-4599-bd4f-49d6f1a8166e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd75f7e4d024fc0904348990b9e3863', 'request_id': 'req-ddc51054-2c64-4599-bd4f-49d6f1a8166e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:16.769303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ddc51054-2c64-4599-bd4f-49d6f1a8166e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd75f7e4d024fc0904348990b9e3863', 'request_id': 'req-ddc51054-2c64-4599-bd4f-49d6f1a8166e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:16.781214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ddc51054-2c64-4599-bd4f-49d6f1a8166e admin admin] The token cache is being invalidate because project 0dd75f7e4d024fc0904348990b9e3863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:38:16.781510 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ddc51054-2c64-4599-bd4f-49d6f1a8166e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:16.782350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ddc51054-2c64-4599-bd4f-49d6f1a8166e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:16.784327 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1028/2070] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:38:16 2021] DELETE /identity/v3/projects/0dd75f7e4d024fc0904348990b9e3863 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:16.790159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb33a5-49b9-4fb9-a71a-82b29e403e35 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:16.790758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb33a5-49b9-4fb9-a71a-82b29e403e35 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:16.790758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb33a5-49b9-4fb9-a71a-82b29e403e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:16.810214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3ffb33a5-49b9-4fb9-a71a-82b29e403e35 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:16.811496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3ffb33a5-49b9-4fb9-a71a-82b29e403e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:16.875736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1043/2071] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:16.884438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b408c70-8a93-49b4-932d-035baa84b41e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:16.885110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b408c70-8a93-49b4-932d-035baa84b41e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:16.885110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b408c70-8a93-49b4-932d-035baa84b41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:16.909164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-3b408c70-8a93-49b4-932d-035baa84b41e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:16.910535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-3b408c70-8a93-49b4-932d-035baa84b41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:16.919039 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1029/2072] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:16.924559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb33a5-49b9-4fb9-a71a-82b29e403e35 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:16.935182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb33a5-49b9-4fb9-a71a-82b29e403e35 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:16.942966 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f955980-70cb-4c84-8da3-cf69a0788e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:16.943737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f955980-70cb-4c84-8da3-cf69a0788e08 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:16.944093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f955980-70cb-4c84-8da3-cf69a0788e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:16.944438 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f955980-70cb-4c84-8da3-cf69a0788e08 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:16.945182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f955980-70cb-4c84-8da3-cf69a0788e08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:38:16.945491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f955980-70cb-4c84-8da3-cf69a0788e08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:16.947193 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f955980-70cb-4c84-8da3-cf69a0788e08 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:16.963895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1044/2073] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:38:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:38:16.965162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b408c70-8a93-49b4-932d-035baa84b41e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:16.975013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b408c70-8a93-49b4-932d-035baa84b41e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:16.980122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01a0c2-91ec-489e-ab88-d33ec9ca7e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:16.980820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01a0c2-91ec-489e-ab88-d33ec9ca7e76 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:16.981103 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01a0c2-91ec-489e-ab88-d33ec9ca7e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:16.981379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01a0c2-91ec-489e-ab88-d33ec9ca7e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:16.982131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01a0c2-91ec-489e-ab88-d33ec9ca7e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:16.984086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01a0c2-91ec-489e-ab88-d33ec9ca7e76 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:17.083852 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1030/2074] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:38:16 2021] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:38:17.087606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f955980-70cb-4c84-8da3-cf69a0788e08 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:17.099706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f955980-70cb-4c84-8da3-cf69a0788e08 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:17.163546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2e063-b163-47a3-9167-e2b97df07353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:17.163816 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2e063-b163-47a3-9167-e2b97df07353 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:17.164027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2e063-b163-47a3-9167-e2b97df07353 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:17.164364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2e063-b163-47a3-9167-e2b97df07353 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:17.165085 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2e063-b163-47a3-9167-e2b97df07353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:17.167075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2e063-b163-47a3-9167-e2b97df07353 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:17.262436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1045/2075] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:38:17 2021] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:38:17.267459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01a0c2-91ec-489e-ab88-d33ec9ca7e76 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:17.277598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01a0c2-91ec-489e-ab88-d33ec9ca7e76 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:17.282492 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bb00f-e4bc-437c-a324-4d026a38e1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:17.283146 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb00f-e4bc-437c-a324-4d026a38e1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:17.283425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb00f-e4bc-437c-a324-4d026a38e1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:17.283699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb00f-e4bc-437c-a324-4d026a38e1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:17.284556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bb00f-e4bc-437c-a324-4d026a38e1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:17.286182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bb00f-e4bc-437c-a324-4d026a38e1d1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:17.296873 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1031/2076] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:38:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:38:17.301842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2e063-b163-47a3-9167-e2b97df07353 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:17.313066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2e063-b163-47a3-9167-e2b97df07353 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:17.318496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e762f39-dd91-45f4-acb6-8574d1b6dc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:17.319196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e762f39-dd91-45f4-acb6-8574d1b6dc40 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:17.319454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e762f39-dd91-45f4-acb6-8574d1b6dc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:17.323309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e762f39-dd91-45f4-acb6-8574d1b6dc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:17.323309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e762f39-dd91-45f4-acb6-8574d1b6dc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:17.323309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e762f39-dd91-45f4-acb6-8574d1b6dc40 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:17.332540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1046/2077] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:38:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:38:17.336834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bb00f-e4bc-437c-a324-4d026a38e1d1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:17.346672 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bb00f-e4bc-437c-a324-4d026a38e1d1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:17.351813 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec9cd7-d922-408a-8df4-90ef85df9490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:17.352690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec9cd7-d922-408a-8df4-90ef85df9490 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:17.352972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec9cd7-d922-408a-8df4-90ef85df9490 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:17.353251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec9cd7-d922-408a-8df4-90ef85df9490 admin admin] PATH_INFO: `/v3/projects/18663667e7754b9193cc9d2fdd59bc16/users/78115a426934495badf1f5aa6dd61c56/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:17.368862 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec9cd7-d922-408a-8df4-90ef85df9490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18663667e7754b9193cc9d2fdd59bc16, user_id=78115a426934495badf1f5aa6dd61c56, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:17.371515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec9cd7-d922-408a-8df4-90ef85df9490 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:17.449853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1032/2078] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:38:17 2021] PUT /identity/v3/projects/18663667e7754b9193cc9d2fdd59bc16/users/78115a426934495badf1f5aa6dd61c56/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:38:17.460465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6424a4-1b4d-42ef-ba6e-670002fdf390 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:17.460751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6424a4-1b4d-42ef-ba6e-670002fdf390 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:17.461034 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6424a4-1b4d-42ef-ba6e-670002fdf390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:17.490847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-1e6424a4-1b4d-42ef-ba6e-670002fdf390 None None] MFA Rules not processed for user `78115a426934495badf1f5aa6dd61c56`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:17.492083 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1e6424a4-1b4d-42ef-ba6e-670002fdf390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:17.553032 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec9cd7-d922-408a-8df4-90ef85df9490 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:17.554823 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-20ec9cd7-d922-408a-8df4-90ef85df9490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:17.571760 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1047/2079] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:17 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:17.583589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6424a4-1b4d-42ef-ba6e-670002fdf390 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:17.584973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1e6424a4-1b4d-42ef-ba6e-670002fdf390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:17.637447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec9cd7-d922-408a-8df4-90ef85df9490 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:17.644635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:17.645737 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:17.646197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:17.646626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] PATH_INFO: `/v3/users/7865f77162aa4c6ebf0edaf301c8a88f` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:17.647962 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7865f77162aa4c6ebf0edaf301c8a88f)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:17.649890 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:17.667729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6424a4-1b4d-42ef-ba6e-670002fdf390 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:17.679897 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76634a5b-ebcd-4bb5-9c6f-6cec6b3c3efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:17.679897 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76634a5b-ebcd-4bb5-9c6f-6cec6b3c3efb service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:17.679897 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76634a5b-ebcd-4bb5-9c6f-6cec6b3c3efb service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:17.679897 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76634a5b-ebcd-4bb5-9c6f-6cec6b3c3efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:17.687053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76634a5b-ebcd-4bb5-9c6f-6cec6b3c3efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:17.690436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76634a5b-ebcd-4bb5-9c6f-6cec6b3c3efb service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:17.699639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1048/2080] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:17 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:38:17.893608 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7865f77162aa4c6ebf0edaf301c8a88f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:17.894181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7865f77162aa4c6ebf0edaf301c8a88f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:17.900594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7865f77162aa4c6ebf0edaf301c8a88f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:18.043739 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7865f77162aa4c6ebf0edaf301c8a88f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:18.056073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7865f77162aa4c6ebf0edaf301c8a88f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:18.062167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1033/2081] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:38:17 2021] DELETE /identity/v3/users/7865f77162aa4c6ebf0edaf301c8a88f => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:38:18.067067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957893ba-fc91-429f-8f8a-c6035dd871f8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:18.067558 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957893ba-fc91-429f-8f8a-c6035dd871f8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:18.067672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957893ba-fc91-429f-8f8a-c6035dd871f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:18.084888 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-957893ba-fc91-429f-8f8a-c6035dd871f8 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:18.086120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-957893ba-fc91-429f-8f8a-c6035dd871f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:18.150524 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1049/2082] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:38:18.156786 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:18.158895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:18.216469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c39cdd-138f-4aba-9637-b63700cbbc3b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:18.221805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed2bef-0784-446c-9c27-e2e8a6a7f188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:18.224328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2bef-0784-446c-9c27-e2e8a6a7f188 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:18.224689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2bef-0784-446c-9c27-e2e8a6a7f188 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:18.225035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2bef-0784-446c-9c27-e2e8a6a7f188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:18.238814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed2bef-0784-446c-9c27-e2e8a6a7f188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:18.240457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed2bef-0784-446c-9c27-e2e8a6a7f188 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:18.250398 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1034/2083] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:38:18.747917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957893ba-fc91-429f-8f8a-c6035dd871f8 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:18.749358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-957893ba-fc91-429f-8f8a-c6035dd871f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:18.762670 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957893ba-fc91-429f-8f8a-c6035dd871f8 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:18.768353 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188178e-e1c3-4bf7-bb69-e0f570b97a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:18.769221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188178e-e1c3-4bf7-bb69-e0f570b97a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:18.769497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188178e-e1c3-4bf7-bb69-e0f570b97a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:18.769775 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188178e-e1c3-4bf7-bb69-e0f570b97a71 admin admin] PATH_INFO: `/v3/projects/6c259659aa644d5d8f2591e4158c1dba` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:18.770999 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188178e-e1c3-4bf7-bb69-e0f570b97a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c259659aa644d5d8f2591e4158c1dba)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:18.773001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188178e-e1c3-4bf7-bb69-e0f570b97a71 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:18.905575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a188178e-e1c3-4bf7-bb69-e0f570b97a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c259659aa644d5d8f2591e4158c1dba', 'request_id': 'req-a188178e-e1c3-4bf7-bb69-e0f570b97a71'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:18.997654 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a188178e-e1c3-4bf7-bb69-e0f570b97a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c259659aa644d5d8f2591e4158c1dba', 'request_id': 'req-a188178e-e1c3-4bf7-bb69-e0f570b97a71'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:19.004246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a188178e-e1c3-4bf7-bb69-e0f570b97a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c259659aa644d5d8f2591e4158c1dba', 'request_id': 'req-a188178e-e1c3-4bf7-bb69-e0f570b97a71'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:19.015037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a188178e-e1c3-4bf7-bb69-e0f570b97a71 admin admin] The token cache is being invalidate because project 6c259659aa644d5d8f2591e4158c1dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:38:19.015329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a188178e-e1c3-4bf7-bb69-e0f570b97a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:19.015953 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a188178e-e1c3-4bf7-bb69-e0f570b97a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:19.017674 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1050/2084] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:38:18 2021] DELETE /identity/v3/projects/6c259659aa644d5d8f2591e4158c1dba => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:19.023376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054749-a07a-4f0b-99da-135a3285e730 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:19.023832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054749-a07a-4f0b-99da-135a3285e730 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:19.023920 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054749-a07a-4f0b-99da-135a3285e730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:19.042152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f4054749-a07a-4f0b-99da-135a3285e730 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:19.043363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f4054749-a07a-4f0b-99da-135a3285e730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:19.104402 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1035/2085] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:38:19.113359 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558b535-79ce-4580-af1c-d9e782204037 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:19.113831 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558b535-79ce-4580-af1c-d9e782204037 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:19.113989 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558b535-79ce-4580-af1c-d9e782204037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:19.133945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d558b535-79ce-4580-af1c-d9e782204037 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:19.135148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d558b535-79ce-4580-af1c-d9e782204037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:19.142947 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1051/2086] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:19.147318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4054749-a07a-4f0b-99da-135a3285e730 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:19.156938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4054749-a07a-4f0b-99da-135a3285e730 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:19.162993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f8a53-5bf6-442f-84fd-4fea0893f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:19.164082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f8a53-5bf6-442f-84fd-4fea0893f842 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:19.164082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f8a53-5bf6-442f-84fd-4fea0893f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:19.164299 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f8a53-5bf6-442f-84fd-4fea0893f842 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:19.165018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f8a53-5bf6-442f-84fd-4fea0893f842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:38:19.165317 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f8a53-5bf6-442f-84fd-4fea0893f842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:19.166913 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f8a53-5bf6-442f-84fd-4fea0893f842 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:19.181768 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1036/2087] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:38:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:38:19.186160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558b535-79ce-4580-af1c-d9e782204037 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:19.195120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558b535-79ce-4580-af1c-d9e782204037 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:19.199761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a2293-0adc-4f46-9461-eb6bf520d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:19.200404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a2293-0adc-4f46-9461-eb6bf520d88c admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:19.200679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a2293-0adc-4f46-9461-eb6bf520d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:19.200948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a2293-0adc-4f46-9461-eb6bf520d88c admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:19.203985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a2293-0adc-4f46-9461-eb6bf520d88c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:19.203985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a2293-0adc-4f46-9461-eb6bf520d88c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:19.285412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1052/2088] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:38:19 2021] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:38:19.289481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f8a53-5bf6-442f-84fd-4fea0893f842 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:19.302078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f8a53-5bf6-442f-84fd-4fea0893f842 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:19.357534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08409c4b-904b-4e02-924d-07f77bebdcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:19.358256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08409c4b-904b-4e02-924d-07f77bebdcdb admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:19.358525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08409c4b-904b-4e02-924d-07f77bebdcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:19.363438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08409c4b-904b-4e02-924d-07f77bebdcdb admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:19.363438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08409c4b-904b-4e02-924d-07f77bebdcdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:19.363438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08409c4b-904b-4e02-924d-07f77bebdcdb admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:19.441330 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1037/2089] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:38:19 2021] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:38:19.442797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a2293-0adc-4f46-9461-eb6bf520d88c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:19.453225 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a2293-0adc-4f46-9461-eb6bf520d88c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:19.458909 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408d1e3-63d6-448e-ba97-ea1197b14230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:19.459814 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408d1e3-63d6-448e-ba97-ea1197b14230 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:19.460322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408d1e3-63d6-448e-ba97-ea1197b14230 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:19.461080 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408d1e3-63d6-448e-ba97-ea1197b14230 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:19.461433 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408d1e3-63d6-448e-ba97-ea1197b14230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:19.463192 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408d1e3-63d6-448e-ba97-ea1197b14230 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:19.475109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1053/2090] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:38:19 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:38:19.478970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08409c4b-904b-4e02-924d-07f77bebdcdb admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:19.489802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08409c4b-904b-4e02-924d-07f77bebdcdb admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:19.494470 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f4902-5547-40d5-8f82-a71d0e7b9074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:19.495169 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4902-5547-40d5-8f82-a71d0e7b9074 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:19.495404 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4902-5547-40d5-8f82-a71d0e7b9074 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:19.495680 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4902-5547-40d5-8f82-a71d0e7b9074 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:19.496549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f4902-5547-40d5-8f82-a71d0e7b9074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:19.498287 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f4902-5547-40d5-8f82-a71d0e7b9074 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:19.510151 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1038/2091] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:38:19 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:38:19.515084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408d1e3-63d6-448e-ba97-ea1197b14230 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:19.527762 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408d1e3-63d6-448e-ba97-ea1197b14230 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:19.537274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78ec75-2405-4272-b49e-a177f96ff391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:19.538476 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ec75-2405-4272-b49e-a177f96ff391 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:19.538476 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ec75-2405-4272-b49e-a177f96ff391 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:19.538737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ec75-2405-4272-b49e-a177f96ff391 admin admin] PATH_INFO: `/v3/projects/4fdefacf201f4fcd8918bec8268443bb/users/b6b5ec2a16954801843a6162c3267736/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:19.554570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78ec75-2405-4272-b49e-a177f96ff391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdefacf201f4fcd8918bec8268443bb, user_id=b6b5ec2a16954801843a6162c3267736, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:19.559838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78ec75-2405-4272-b49e-a177f96ff391 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:19.654998 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1054/2092] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:38:19 2021] PUT /identity/v3/projects/4fdefacf201f4fcd8918bec8268443bb/users/b6b5ec2a16954801843a6162c3267736/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:38:19.667926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e74b0d-6422-4cf2-ad09-04ec8887e544 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:19.668220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e74b0d-6422-4cf2-ad09-04ec8887e544 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:19.668499 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e74b0d-6422-4cf2-ad09-04ec8887e544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:19.698200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-08e74b0d-6422-4cf2-ad09-04ec8887e544 None None] MFA Rules not processed for user `b6b5ec2a16954801843a6162c3267736`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:19.699457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-08e74b0d-6422-4cf2-ad09-04ec8887e544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:19.765241 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1039/2093] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:19 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:19.802316 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78ec75-2405-4272-b49e-a177f96ff391 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:19.804086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-db78ec75-2405-4272-b49e-a177f96ff391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:19.864155 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78ec75-2405-4272-b49e-a177f96ff391 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:19.871240 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d397c-e2ae-47d5-8f8f-571dc005eeb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:19.871964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d397c-e2ae-47d5-8f8f-571dc005eeb2 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:19.872431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d397c-e2ae-47d5-8f8f-571dc005eeb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:19.872779 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d397c-e2ae-47d5-8f8f-571dc005eeb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:19.882935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d397c-e2ae-47d5-8f8f-571dc005eeb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:19.884406 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d397c-e2ae-47d5-8f8f-571dc005eeb2 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:19.894035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1055/2094] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:19 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:38:29.322668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e74b0d-6422-4cf2-ad09-04ec8887e544 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:29.424934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e74b0d-6422-4cf2-ad09-04ec8887e544 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:29.429398 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:29.430285 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:29.430561 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:29.430836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] PATH_INFO: `/v3/users/b6b5ec2a16954801843a6162c3267736` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:29.432170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b5ec2a16954801843a6162c3267736)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:29.434112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:29.614789 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b5ec2a16954801843a6162c3267736'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:29.615452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b5ec2a16954801843a6162c3267736'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:29.622308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b5ec2a16954801843a6162c3267736'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:29.707341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b5ec2a16954801843a6162c3267736'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:29.719131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b5ec2a16954801843a6162c3267736'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:29.725236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1040/2095] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:38:29 2021] DELETE /identity/v3/users/b6b5ec2a16954801843a6162c3267736 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:29.730459 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecea1ea-fdf5-4dfc-a261-84f65503248e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:29.730990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecea1ea-fdf5-4dfc-a261-84f65503248e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:29.731295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecea1ea-fdf5-4dfc-a261-84f65503248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:29.781655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-2ecea1ea-fdf5-4dfc-a261-84f65503248e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:29.782926 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2ecea1ea-fdf5-4dfc-a261-84f65503248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:29.843485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1056/2096] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:29.855329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:29.856757 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:29.951727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d8e26-c864-4415-8894-43ee058be859 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:29.952015 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d8e26-c864-4415-8894-43ee058be859 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:29.952297 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d8e26-c864-4415-8894-43ee058be859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:29.971335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-4d9d8e26-c864-4415-8894-43ee058be859 None None] MFA Rules not processed for user `569387965b184cc3a1bc2aecdbede0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:29.972617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4d9d8e26-c864-4415-8894-43ee058be859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:29.984736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca1d3b-5cd2-4625-9983-bcaa8890399e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:29.989518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e5ef1-e3ac-4e6f-957e-dc922b5f192a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:29.990304 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e5ef1-e3ac-4e6f-957e-dc922b5f192a service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:29.990654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e5ef1-e3ac-4e6f-957e-dc922b5f192a service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:29.990997 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e5ef1-e3ac-4e6f-957e-dc922b5f192a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:30.001236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e5ef1-e3ac-4e6f-957e-dc922b5f192a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:30.014730 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e5ef1-e3ac-4e6f-957e-dc922b5f192a service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:30.014730 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1041/2097] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:38:30.086049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1057/2098] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:29 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:30.465957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e5ef1-e3ac-4e6f-957e-dc922b5f192a service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:30.468313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-872e5ef1-e3ac-4e6f-957e-dc922b5f192a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:30.483632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e5ef1-e3ac-4e6f-957e-dc922b5f192a service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:30.489058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:30.490109 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:30.490721 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:30.491220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2 admin admin] PATH_INFO: `/v3/projects/4fdefacf201f4fcd8918bec8268443bb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:30.492445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fdefacf201f4fcd8918bec8268443bb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:30.494445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:30.617433 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fdefacf201f4fcd8918bec8268443bb', 'request_id': 'req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:30.686938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fdefacf201f4fcd8918bec8268443bb', 'request_id': 'req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:30.692876 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fdefacf201f4fcd8918bec8268443bb', 'request_id': 'req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:30.703613 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2 admin admin] The token cache is being invalidate because project 4fdefacf201f4fcd8918bec8268443bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:38:30.703903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:30.704564 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e91d3292-7133-49f7-ac44-8ce6c8fa2ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:30.706151 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1042/2099] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:38:30 2021] DELETE /identity/v3/projects/4fdefacf201f4fcd8918bec8268443bb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:30.711835 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1df13d-5e88-4a9b-b629-b9e540770afc None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:30.712127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1df13d-5e88-4a9b-b629-b9e540770afc None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:30.712410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1df13d-5e88-4a9b-b629-b9e540770afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:30.750808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-bd1df13d-5e88-4a9b-b629-b9e540770afc None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:30.751934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-bd1df13d-5e88-4a9b-b629-b9e540770afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:30.807798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1058/2100] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:38:30.815738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3157255-df9a-4055-9d08-3f5f8ce7fe1e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:30.816029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3157255-df9a-4055-9d08-3f5f8ce7fe1e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:30.816310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3157255-df9a-4055-9d08-3f5f8ce7fe1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:30.835833 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f3157255-df9a-4055-9d08-3f5f8ce7fe1e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:30.837019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f3157255-df9a-4055-9d08-3f5f8ce7fe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:30.851553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1043/2101] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:30.856164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1df13d-5e88-4a9b-b629-b9e540770afc None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:30.866324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1df13d-5e88-4a9b-b629-b9e540770afc None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:30.873795 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e989fa4-8909-4492-9900-13f7163a2f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:30.874478 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989fa4-8909-4492-9900-13f7163a2f44 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:30.874762 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989fa4-8909-4492-9900-13f7163a2f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:30.875036 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989fa4-8909-4492-9900-13f7163a2f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:30.875775 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e989fa4-8909-4492-9900-13f7163a2f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:38:30.876085 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e989fa4-8909-4492-9900-13f7163a2f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:30.877902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e989fa4-8909-4492-9900-13f7163a2f44 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:30.890094 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1059/2102] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:38:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:38:30.897296 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3157255-df9a-4055-9d08-3f5f8ce7fe1e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:30.912496 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3157255-df9a-4055-9d08-3f5f8ce7fe1e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:30.918060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a503e58-3c3e-4e72-9b37-16396db9848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:30.918943 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a503e58-3c3e-4e72-9b37-16396db9848f admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:30.919405 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a503e58-3c3e-4e72-9b37-16396db9848f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:30.919832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a503e58-3c3e-4e72-9b37-16396db9848f admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:30.920676 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a503e58-3c3e-4e72-9b37-16396db9848f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:30.922760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a503e58-3c3e-4e72-9b37-16396db9848f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:31.014940 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1044/2103] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:38:30 2021] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:38:31.018970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e989fa4-8909-4492-9900-13f7163a2f44 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:31.028949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e989fa4-8909-4492-9900-13f7163a2f44 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:31.084996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37458-feb9-4fbc-9d0d-651582f75777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:31.085770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37458-feb9-4fbc-9d0d-651582f75777 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:31.086135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37458-feb9-4fbc-9d0d-651582f75777 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:31.086471 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37458-feb9-4fbc-9d0d-651582f75777 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:31.087552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a37458-feb9-4fbc-9d0d-651582f75777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:31.090988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a37458-feb9-4fbc-9d0d-651582f75777 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:31.173378 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1060/2104] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:38:31 2021] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:38:31.178464 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a503e58-3c3e-4e72-9b37-16396db9848f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:31.188984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a503e58-3c3e-4e72-9b37-16396db9848f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:31.193795 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5b887-da91-45d1-b85c-045019bd644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:31.194561 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5b887-da91-45d1-b85c-045019bd644c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:31.194849 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5b887-da91-45d1-b85c-045019bd644c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:31.200977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5b887-da91-45d1-b85c-045019bd644c admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:31.200977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5b887-da91-45d1-b85c-045019bd644c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:31.200977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5b887-da91-45d1-b85c-045019bd644c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:31.213776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1045/2105] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:38:31.215571 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37458-feb9-4fbc-9d0d-651582f75777 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:31.230981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37458-feb9-4fbc-9d0d-651582f75777 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:31.246215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238ca8f-1b23-4d8c-a9b0-a244edfee37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:31.246886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238ca8f-1b23-4d8c-a9b0-a244edfee37d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:31.247348 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238ca8f-1b23-4d8c-a9b0-a244edfee37d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:31.247769 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238ca8f-1b23-4d8c-a9b0-a244edfee37d admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:31.248639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238ca8f-1b23-4d8c-a9b0-a244edfee37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:31.250728 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238ca8f-1b23-4d8c-a9b0-a244edfee37d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:31.271304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1061/2106] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:38:31.272234 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5b887-da91-45d1-b85c-045019bd644c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:31.284747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5b887-da91-45d1-b85c-045019bd644c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:31.295086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122e720-031b-4ee0-b8f1-4d3b8032de53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:31.295880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122e720-031b-4ee0-b8f1-4d3b8032de53 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:31.296215 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122e720-031b-4ee0-b8f1-4d3b8032de53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:31.296587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122e720-031b-4ee0-b8f1-4d3b8032de53 admin admin] PATH_INFO: `/v3/projects/1f45ccabb8814c61a2d3fc688ec2205b/users/231c34bcbaed4a3ba4e13374f83cbb0a/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:31.316383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122e720-031b-4ee0-b8f1-4d3b8032de53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f45ccabb8814c61a2d3fc688ec2205b, user_id=231c34bcbaed4a3ba4e13374f83cbb0a, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:31.319251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122e720-031b-4ee0-b8f1-4d3b8032de53 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:31.390926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1046/2107] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:38:31 2021] PUT /identity/v3/projects/1f45ccabb8814c61a2d3fc688ec2205b/users/231c34bcbaed4a3ba4e13374f83cbb0a/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:38:31.394474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b40a97-866e-4b6c-8928-e247cd7002cd None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:31.395112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b40a97-866e-4b6c-8928-e247cd7002cd None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:31.395835 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b40a97-866e-4b6c-8928-e247cd7002cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:31.433333 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-44b40a97-866e-4b6c-8928-e247cd7002cd None None] MFA Rules not processed for user `231c34bcbaed4a3ba4e13374f83cbb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:31.434692 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-44b40a97-866e-4b6c-8928-e247cd7002cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:31.514868 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1062/2108] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:31 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:31.525029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122e720-031b-4ee0-b8f1-4d3b8032de53 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:31.526810 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0122e720-031b-4ee0-b8f1-4d3b8032de53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:31.584797 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122e720-031b-4ee0-b8f1-4d3b8032de53 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:31.588589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984c85c-9d61-4f5d-addb-f007d7f49773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:31.589242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984c85c-9d61-4f5d-addb-f007d7f49773 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:31.589523 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984c85c-9d61-4f5d-addb-f007d7f49773 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:31.589796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984c85c-9d61-4f5d-addb-f007d7f49773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:31.599180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984c85c-9d61-4f5d-addb-f007d7f49773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:31.600694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984c85c-9d61-4f5d-addb-f007d7f49773 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:31.611087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1047/2109] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:31 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:38:35.626191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb8240-7c11-4ae1-9614-9fa8b0bc01cf None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:35.626697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb8240-7c11-4ae1-9614-9fa8b0bc01cf None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:35.626851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb8240-7c11-4ae1-9614-9fa8b0bc01cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:35.644811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c9bb8240-7c11-4ae1-9614-9fa8b0bc01cf None None] MFA Rules not processed for user `231c34bcbaed4a3ba4e13374f83cbb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:35.669940 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c9bb8240-7c11-4ae1-9614-9fa8b0bc01cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:35.684483 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1063/2110] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:35 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:36.065559 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81349ae-4362-4663-9f67-5f9d5a8e6553 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:36.066080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81349ae-4362-4663-9f67-5f9d5a8e6553 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:36.070424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81349ae-4362-4663-9f67-5f9d5a8e6553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:36.085725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f81349ae-4362-4663-9f67-5f9d5a8e6553 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:36.087005 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f81349ae-4362-4663-9f67-5f9d5a8e6553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:36.161622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1048/2111] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:38:36 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:38:36.216993 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb8240-7c11-4ae1-9614-9fa8b0bc01cf None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:36.218327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c9bb8240-7c11-4ae1-9614-9fa8b0bc01cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:36.298110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb8240-7c11-4ae1-9614-9fa8b0bc01cf None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:36.304868 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf306d7-158b-465a-88df-9b89d8e8fa34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:36.305535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf306d7-158b-465a-88df-9b89d8e8fa34 service swift] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:36.305946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf306d7-158b-465a-88df-9b89d8e8fa34 service swift] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:36.306202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf306d7-158b-465a-88df-9b89d8e8fa34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:36.315514 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf306d7-158b-465a-88df-9b89d8e8fa34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:36.317198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf306d7-158b-465a-88df-9b89d8e8fa34 service swift] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:36.326472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1064/2112] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:38:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 14:38:40.937481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81349ae-4362-4663-9f67-5f9d5a8e6553 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:40.944541 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f81349ae-4362-4663-9f67-5f9d5a8e6553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:41.076172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81349ae-4362-4663-9f67-5f9d5a8e6553 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:41.083003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:41.084814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:41.085386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:41.085669 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] PATH_INFO: `/v3/users/78115a426934495badf1f5aa6dd61c56` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:41.087392 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78115a426934495badf1f5aa6dd61c56)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:41.089465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:41.396886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78115a426934495badf1f5aa6dd61c56'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:41.398019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78115a426934495badf1f5aa6dd61c56'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:41.411348 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78115a426934495badf1f5aa6dd61c56'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:41.478436 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78115a426934495badf1f5aa6dd61c56'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:41.491963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78115a426934495badf1f5aa6dd61c56'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:41.513382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1049/2113] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:38:40 2021] DELETE /identity/v3/users/78115a426934495badf1f5aa6dd61c56 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:41.519021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2e4a6-70b7-4c0d-8c5a-438030348858 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:41.519527 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2e4a6-70b7-4c0d-8c5a-438030348858 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:41.519627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2e4a6-70b7-4c0d-8c5a-438030348858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:41.542483 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c3a2e4a6-70b7-4c0d-8c5a-438030348858 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:41.544232 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c3a2e4a6-70b7-4c0d-8c5a-438030348858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:41.622205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1065/2114] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:41.643720 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:41.645361 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:41.742658 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c881f24-8f32-4c18-820e-8773f35359a1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:41.746589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a035eba-5123-4412-9d44-8d4b563a9aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:41.747260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a035eba-5123-4412-9d44-8d4b563a9aac service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:41.747542 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a035eba-5123-4412-9d44-8d4b563a9aac service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:41.747819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a035eba-5123-4412-9d44-8d4b563a9aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:41.761555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a035eba-5123-4412-9d44-8d4b563a9aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:41.763741 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a035eba-5123-4412-9d44-8d4b563a9aac service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:41.788952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1050/2115] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:38:42.311838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2e4a6-70b7-4c0d-8c5a-438030348858 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:42.314361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c3a2e4a6-70b7-4c0d-8c5a-438030348858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:42.346723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2e4a6-70b7-4c0d-8c5a-438030348858 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:42.366772 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:42.367762 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:42.368040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:42.368636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe admin admin] PATH_INFO: `/v3/projects/18663667e7754b9193cc9d2fdd59bc16` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:42.370260 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=18663667e7754b9193cc9d2fdd59bc16)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:42.371991 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:42.548211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18663667e7754b9193cc9d2fdd59bc16', 'request_id': 'req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:42.645426 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18663667e7754b9193cc9d2fdd59bc16', 'request_id': 'req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:42.656182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18663667e7754b9193cc9d2fdd59bc16', 'request_id': 'req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:42.681093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe admin admin] The token cache is being invalidate because project 18663667e7754b9193cc9d2fdd59bc16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:38:42.681449 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:42.682075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-dc3b74e3-65e9-4ea6-9b4d-f70f0d74adbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:42.683631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1066/2116] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:38:42 2021] DELETE /identity/v3/projects/18663667e7754b9193cc9d2fdd59bc16 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:42.690722 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e423f69-396a-4dbb-8142-67babf12e960 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:42.691298 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e423f69-396a-4dbb-8142-67babf12e960 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:42.691298 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e423f69-396a-4dbb-8142-67babf12e960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:42.751282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-1e423f69-396a-4dbb-8142-67babf12e960 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:42.753804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1e423f69-396a-4dbb-8142-67babf12e960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:42.840152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1051/2117] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:42.858706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22917bfb-a8a9-4281-b793-6ac358cc7b9e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:42.859045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22917bfb-a8a9-4281-b793-6ac358cc7b9e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:42.859530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22917bfb-a8a9-4281-b793-6ac358cc7b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:42.889651 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-22917bfb-a8a9-4281-b793-6ac358cc7b9e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:42.890959 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-22917bfb-a8a9-4281-b793-6ac358cc7b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:42.900825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1067/2118] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:42.905276 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e423f69-396a-4dbb-8142-67babf12e960 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:42.915883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e423f69-396a-4dbb-8142-67babf12e960 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:42.935011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c55f0-5dd8-4f31-9979-73094bdcd9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:42.935806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c55f0-5dd8-4f31-9979-73094bdcd9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:42.936117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c55f0-5dd8-4f31-9979-73094bdcd9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:42.936472 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c55f0-5dd8-4f31-9979-73094bdcd9d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:42.937283 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c55f0-5dd8-4f31-9979-73094bdcd9d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:38:42.937651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c55f0-5dd8-4f31-9979-73094bdcd9d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:42.941093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c55f0-5dd8-4f31-9979-73094bdcd9d1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:42.959981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1052/2119] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:38:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:38:42.964670 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22917bfb-a8a9-4281-b793-6ac358cc7b9e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:42.976909 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22917bfb-a8a9-4281-b793-6ac358cc7b9e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:42.982868 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e6170-aea2-44b3-8b44-411c319fde16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:42.983612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e6170-aea2-44b3-8b44-411c319fde16 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:42.983960 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e6170-aea2-44b3-8b44-411c319fde16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:42.984301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e6170-aea2-44b3-8b44-411c319fde16 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:42.984992 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e6170-aea2-44b3-8b44-411c319fde16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:42.987001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e6170-aea2-44b3-8b44-411c319fde16 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:43.466191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1068/2120] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:38:42 2021] POST /identity/v3/projects => generated 397 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:38:43.470418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c55f0-5dd8-4f31-9979-73094bdcd9d1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:43.482804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c55f0-5dd8-4f31-9979-73094bdcd9d1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:43.550542 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e0412-d981-4e96-864a-d283c883ead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:43.551407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e0412-d981-4e96-864a-d283c883ead9 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:43.551786 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e0412-d981-4e96-864a-d283c883ead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:43.552162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e0412-d981-4e96-864a-d283c883ead9 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:43.552963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e0412-d981-4e96-864a-d283c883ead9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:43.555049 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e0412-d981-4e96-864a-d283c883ead9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:43.669165 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1053/2121] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:38:43 2021] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:38:43.671286 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e6170-aea2-44b3-8b44-411c319fde16 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:43.690766 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e6170-aea2-44b3-8b44-411c319fde16 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:43.700852 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc9b48-6c5e-48ca-b69d-90c02ee0ab48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:43.702093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc9b48-6c5e-48ca-b69d-90c02ee0ab48 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:43.704757 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc9b48-6c5e-48ca-b69d-90c02ee0ab48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:43.706309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc9b48-6c5e-48ca-b69d-90c02ee0ab48 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:43.709857 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc9b48-6c5e-48ca-b69d-90c02ee0ab48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:43.712987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc9b48-6c5e-48ca-b69d-90c02ee0ab48 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:43.734980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1069/2122] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:38:43 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:38:43.735606 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e0412-d981-4e96-864a-d283c883ead9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:43.753675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e0412-d981-4e96-864a-d283c883ead9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:43.763788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e018e-dc3f-4a6f-abbc-cc12d857a9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:43.765414 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e018e-dc3f-4a6f-abbc-cc12d857a9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:43.766688 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e018e-dc3f-4a6f-abbc-cc12d857a9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:43.770066 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e018e-dc3f-4a6f-abbc-cc12d857a9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:43.774118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e018e-dc3f-4a6f-abbc-cc12d857a9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:43.776672 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e018e-dc3f-4a6f-abbc-cc12d857a9b3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:43.802368 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc9b48-6c5e-48ca-b69d-90c02ee0ab48 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:43.804249 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1054/2123] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:38:43 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:38:43.820236 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc9b48-6c5e-48ca-b69d-90c02ee0ab48 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:43.832580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c957eda-881e-443c-8ceb-8904471f3ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:43.835404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c957eda-881e-443c-8ceb-8904471f3ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:43.835865 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c957eda-881e-443c-8ceb-8904471f3ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:43.836445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c957eda-881e-443c-8ceb-8904471f3ef3 admin admin] PATH_INFO: `/v3/projects/db852e0bf2aa4b008b5f0a34ced24d6a/users/9ff8dac4b5af4745a926e2db51a22e50/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:43.862932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c957eda-881e-443c-8ceb-8904471f3ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db852e0bf2aa4b008b5f0a34ced24d6a, user_id=9ff8dac4b5af4745a926e2db51a22e50, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:43.870554 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c957eda-881e-443c-8ceb-8904471f3ef3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:43.962606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1070/2124] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:38:43 2021] PUT /identity/v3/projects/db852e0bf2aa4b008b5f0a34ced24d6a/users/9ff8dac4b5af4745a926e2db51a22e50/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:43.976338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00259e4-f71f-4585-bf39-a8159e986ad0 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:43.976627 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00259e4-f71f-4585-bf39-a8159e986ad0 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:43.976901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00259e4-f71f-4585-bf39-a8159e986ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:44.007135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f00259e4-f71f-4585-bf39-a8159e986ad0 None None] MFA Rules not processed for user `9ff8dac4b5af4745a926e2db51a22e50`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:44.008281 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f00259e4-f71f-4585-bf39-a8159e986ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:44.077057 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1055/2125] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:43 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:44.088746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c957eda-881e-443c-8ceb-8904471f3ef3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:44.091605 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-6c957eda-881e-443c-8ceb-8904471f3ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:44.166795 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c957eda-881e-443c-8ceb-8904471f3ef3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:44.170960 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8839b1b-9dfc-431f-89ba-57ae42f3aec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:44.171639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8839b1b-9dfc-431f-89ba-57ae42f3aec8 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:44.171922 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8839b1b-9dfc-431f-89ba-57ae42f3aec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:44.172199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8839b1b-9dfc-431f-89ba-57ae42f3aec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:44.181910 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8839b1b-9dfc-431f-89ba-57ae42f3aec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:44.183347 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8839b1b-9dfc-431f-89ba-57ae42f3aec8 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:44.193144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1071/2126] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:44 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:38:53.615306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00259e4-f71f-4585-bf39-a8159e986ad0 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:53.692122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00259e4-f71f-4585-bf39-a8159e986ad0 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:53.696942 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:53.698063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:53.698230 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:53.698508 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] PATH_INFO: `/v3/users/9ff8dac4b5af4745a926e2db51a22e50` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:53.699773 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff8dac4b5af4745a926e2db51a22e50)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:53.701880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:53.921303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff8dac4b5af4745a926e2db51a22e50'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:53.921973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff8dac4b5af4745a926e2db51a22e50'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:53.929762 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff8dac4b5af4745a926e2db51a22e50'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:54.026858 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff8dac4b5af4745a926e2db51a22e50'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:54.040240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff8dac4b5af4745a926e2db51a22e50'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:54.046360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1056/2127] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:38:53 2021] DELETE /identity/v3/users/9ff8dac4b5af4745a926e2db51a22e50 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:54.053001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d8ced-7460-4554-a26b-edfc3f17c2b6 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:54.053475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d8ced-7460-4554-a26b-edfc3f17c2b6 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:54.053564 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d8ced-7460-4554-a26b-edfc3f17c2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:54.071076 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-188d8ced-7460-4554-a26b-edfc3f17c2b6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:54.072275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-188d8ced-7460-4554-a26b-edfc3f17c2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:54.131515 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1072/2128] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:54.141428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:54.151924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:54.204709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdc7a7-5f20-45bb-bd36-57ea6754c37b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:54.208520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb05fd-fc9d-491f-bc21-182673413531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:54.209165 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb05fd-fc9d-491f-bc21-182673413531 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:54.209441 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb05fd-fc9d-491f-bc21-182673413531 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:54.209712 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb05fd-fc9d-491f-bc21-182673413531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:54.219310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb05fd-fc9d-491f-bc21-182673413531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:54.220841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb05fd-fc9d-491f-bc21-182673413531 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:54.230282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1057/2129] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:38:54.817969 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d8ced-7460-4554-a26b-edfc3f17c2b6 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:54.819300 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-188d8ced-7460-4554-a26b-edfc3f17c2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:54.837722 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d8ced-7460-4554-a26b-edfc3f17c2b6 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:54.843422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbbbc5-857e-4edd-aff1-6c4f37be798d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:54.844563 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbbbc5-857e-4edd-aff1-6c4f37be798d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:54.844842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbbbc5-857e-4edd-aff1-6c4f37be798d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:54.845126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbbbc5-857e-4edd-aff1-6c4f37be798d admin admin] PATH_INFO: `/v3/projects/db852e0bf2aa4b008b5f0a34ced24d6a` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:54.847252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbbbc5-857e-4edd-aff1-6c4f37be798d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db852e0bf2aa4b008b5f0a34ced24d6a)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:54.850254 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbbbc5-857e-4edd-aff1-6c4f37be798d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:54.959495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-81dbbbc5-857e-4edd-aff1-6c4f37be798d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db852e0bf2aa4b008b5f0a34ced24d6a', 'request_id': 'req-81dbbbc5-857e-4edd-aff1-6c4f37be798d'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:55.024364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-81dbbbc5-857e-4edd-aff1-6c4f37be798d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db852e0bf2aa4b008b5f0a34ced24d6a', 'request_id': 'req-81dbbbc5-857e-4edd-aff1-6c4f37be798d'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:55.030248 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-81dbbbc5-857e-4edd-aff1-6c4f37be798d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db852e0bf2aa4b008b5f0a34ced24d6a', 'request_id': 'req-81dbbbc5-857e-4edd-aff1-6c4f37be798d'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:55.041643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-81dbbbc5-857e-4edd-aff1-6c4f37be798d admin admin] The token cache is being invalidate because project db852e0bf2aa4b008b5f0a34ced24d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:38:55.041960 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-81dbbbc5-857e-4edd-aff1-6c4f37be798d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:55.042650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-81dbbbc5-857e-4edd-aff1-6c4f37be798d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:55.044195 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1073/2130] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:38:54 2021] DELETE /identity/v3/projects/db852e0bf2aa4b008b5f0a34ced24d6a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:55.475998 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb05fd-fc9d-491f-bc21-182673413531 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:55.477466 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-3bfb05fd-fc9d-491f-bc21-182673413531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:55.491562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb05fd-fc9d-491f-bc21-182673413531 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:55.546049 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:55.546831 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:55.547112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:55.547388 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] PATH_INFO: `/v3/users/ebd758eb72054b56ae212c6d1475c93a` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:55.548579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd758eb72054b56ae212c6d1475c93a)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:55.551064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:55.769238 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd758eb72054b56ae212c6d1475c93a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:55.771062 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd758eb72054b56ae212c6d1475c93a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:55.778210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd758eb72054b56ae212c6d1475c93a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:55.850240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd758eb72054b56ae212c6d1475c93a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:55.863180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd758eb72054b56ae212c6d1475c93a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:55.869276 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1058/2131] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:38:55 2021] DELETE /identity/v3/users/ebd758eb72054b56ae212c6d1475c93a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:55.873902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebee20-b9ee-4296-a0ba-34013ac147be None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:55.874377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebee20-b9ee-4296-a0ba-34013ac147be None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:55.874474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebee20-b9ee-4296-a0ba-34013ac147be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:55.892176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-82ebee20-b9ee-4296-a0ba-34013ac147be None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:55.893667 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-82ebee20-b9ee-4296-a0ba-34013ac147be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:55.968858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1074/2132] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:55.979683 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:55.981123 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:56.041393 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637a4f7-a8e2-4467-9235-1d1694ce3d8c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:56.045130 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b094caa-2e16-4744-98d1-9acca38ce947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:56.045774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b094caa-2e16-4744-98d1-9acca38ce947 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:56.046081 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b094caa-2e16-4744-98d1-9acca38ce947 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:56.046354 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b094caa-2e16-4744-98d1-9acca38ce947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:56.057428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b094caa-2e16-4744-98d1-9acca38ce947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:56.057589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b094caa-2e16-4744-98d1-9acca38ce947 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:56.068636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1059/2133] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:38:56.542976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebee20-b9ee-4296-a0ba-34013ac147be None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:56.544484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-82ebee20-b9ee-4296-a0ba-34013ac147be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:56.559766 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebee20-b9ee-4296-a0ba-34013ac147be None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:56.573447 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73837e5b-e5fb-4c94-ad60-d01e32b742e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:56.574371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73837e5b-e5fb-4c94-ad60-d01e32b742e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:56.574656 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73837e5b-e5fb-4c94-ad60-d01e32b742e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:56.574933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73837e5b-e5fb-4c94-ad60-d01e32b742e2 admin admin] PATH_INFO: `/v3/projects/9ef27dea6c3e4679b973388f5c11576b` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:56.576203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73837e5b-e5fb-4c94-ad60-d01e32b742e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef27dea6c3e4679b973388f5c11576b)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:56.578641 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73837e5b-e5fb-4c94-ad60-d01e32b742e2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:56.739865 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-73837e5b-e5fb-4c94-ad60-d01e32b742e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef27dea6c3e4679b973388f5c11576b', 'request_id': 'req-73837e5b-e5fb-4c94-ad60-d01e32b742e2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:56.832714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-73837e5b-e5fb-4c94-ad60-d01e32b742e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef27dea6c3e4679b973388f5c11576b', 'request_id': 'req-73837e5b-e5fb-4c94-ad60-d01e32b742e2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:56.838766 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-73837e5b-e5fb-4c94-ad60-d01e32b742e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef27dea6c3e4679b973388f5c11576b', 'request_id': 'req-73837e5b-e5fb-4c94-ad60-d01e32b742e2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:56.850314 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-73837e5b-e5fb-4c94-ad60-d01e32b742e2 admin admin] The token cache is being invalidate because project 9ef27dea6c3e4679b973388f5c11576b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:38:56.850597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-73837e5b-e5fb-4c94-ad60-d01e32b742e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:56.851213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-73837e5b-e5fb-4c94-ad60-d01e32b742e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:38:56.852792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1075/2134] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:38:56 2021] DELETE /identity/v3/projects/9ef27dea6c3e4679b973388f5c11576b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:56.858590 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab41e61-77b0-4d0e-9dbf-10aa00e6288b None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:56.859092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab41e61-77b0-4d0e-9dbf-10aa00e6288b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:56.859185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab41e61-77b0-4d0e-9dbf-10aa00e6288b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:56.879380 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0ab41e61-77b0-4d0e-9dbf-10aa00e6288b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:56.880595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0ab41e61-77b0-4d0e-9dbf-10aa00e6288b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:56.939685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1060/2135] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:56.950678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b3b09-6b34-4a6c-9342-6b0a93748765 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:56.951199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b3b09-6b34-4a6c-9342-6b0a93748765 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:56.951377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b3b09-6b34-4a6c-9342-6b0a93748765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:56.971692 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c66b3b09-6b34-4a6c-9342-6b0a93748765 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:56.972945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c66b3b09-6b34-4a6c-9342-6b0a93748765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:56.981185 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1076/2136] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:38:56.985471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab41e61-77b0-4d0e-9dbf-10aa00e6288b None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:56.996853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab41e61-77b0-4d0e-9dbf-10aa00e6288b None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:57.001516 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72704a-bdfc-48b9-b8b9-ea177ca6db31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:57.002551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72704a-bdfc-48b9-b8b9-ea177ca6db31 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:57.002765 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72704a-bdfc-48b9-b8b9-ea177ca6db31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:57.003043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72704a-bdfc-48b9-b8b9-ea177ca6db31 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:57.003760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72704a-bdfc-48b9-b8b9-ea177ca6db31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:38:57.004060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72704a-bdfc-48b9-b8b9-ea177ca6db31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:57.005765 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72704a-bdfc-48b9-b8b9-ea177ca6db31 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:57.018839 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1061/2137] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:38:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:38:57.022931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b3b09-6b34-4a6c-9342-6b0a93748765 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:57.031799 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b3b09-6b34-4a6c-9342-6b0a93748765 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:57.037350 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80088a3-be5e-4f56-8d0a-2ddb9233b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:57.038116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80088a3-be5e-4f56-8d0a-2ddb9233b143 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:57.038515 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80088a3-be5e-4f56-8d0a-2ddb9233b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:57.038849 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80088a3-be5e-4f56-8d0a-2ddb9233b143 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:57.039597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80088a3-be5e-4f56-8d0a-2ddb9233b143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:57.041530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80088a3-be5e-4f56-8d0a-2ddb9233b143 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:57.157046 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1077/2138] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:38:57 2021] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:38:57.161233 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72704a-bdfc-48b9-b8b9-ea177ca6db31 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:57.171223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72704a-bdfc-48b9-b8b9-ea177ca6db31 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:57.230405 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bdea4-0321-4f76-aef1-0ba8bb24244f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:57.231195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bdea4-0321-4f76-aef1-0ba8bb24244f admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:57.232246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bdea4-0321-4f76-aef1-0ba8bb24244f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:57.232246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bdea4-0321-4f76-aef1-0ba8bb24244f admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:57.232817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bdea4-0321-4f76-aef1-0ba8bb24244f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:57.234906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bdea4-0321-4f76-aef1-0ba8bb24244f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:57.377917 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1062/2139] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:38:57 2021] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:38:57.380457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80088a3-be5e-4f56-8d0a-2ddb9233b143 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:57.390488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80088a3-be5e-4f56-8d0a-2ddb9233b143 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:57.398143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cc3ce-b2c5-47d1-8fee-b43c6a1692d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:57.401309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cc3ce-b2c5-47d1-8fee-b43c6a1692d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:57.401309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cc3ce-b2c5-47d1-8fee-b43c6a1692d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:57.401309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cc3ce-b2c5-47d1-8fee-b43c6a1692d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:57.401309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cc3ce-b2c5-47d1-8fee-b43c6a1692d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:57.402792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cc3ce-b2c5-47d1-8fee-b43c6a1692d5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:57.414541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1078/2140] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:38:57 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:38:57.419106 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bdea4-0321-4f76-aef1-0ba8bb24244f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:57.431225 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bdea4-0321-4f76-aef1-0ba8bb24244f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:57.437220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20686268-54a6-41cf-982d-fdf5d3ab658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:57.437908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20686268-54a6-41cf-982d-fdf5d3ab658c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:57.438199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20686268-54a6-41cf-982d-fdf5d3ab658c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:57.438476 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20686268-54a6-41cf-982d-fdf5d3ab658c admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:57.439237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20686268-54a6-41cf-982d-fdf5d3ab658c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:57.440975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20686268-54a6-41cf-982d-fdf5d3ab658c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:57.456215 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1063/2141] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:38:57 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:38:57.456849 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cc3ce-b2c5-47d1-8fee-b43c6a1692d5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:57.470268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cc3ce-b2c5-47d1-8fee-b43c6a1692d5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:57.477127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49878847-0c12-4670-8151-71ecfe8d0927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:57.477781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49878847-0c12-4670-8151-71ecfe8d0927 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:57.478097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49878847-0c12-4670-8151-71ecfe8d0927 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:57.478486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49878847-0c12-4670-8151-71ecfe8d0927 admin admin] PATH_INFO: `/v3/projects/2c3972b7a84b4e868b143f35255ea143/users/9f616dad20824b21927f4f6a2a9abaad/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:57.494509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49878847-0c12-4670-8151-71ecfe8d0927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3972b7a84b4e868b143f35255ea143, user_id=9f616dad20824b21927f4f6a2a9abaad, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:57.497239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49878847-0c12-4670-8151-71ecfe8d0927 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:57.567997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1079/2142] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:38:57 2021] PUT /identity/v3/projects/2c3972b7a84b4e868b143f35255ea143/users/9f616dad20824b21927f4f6a2a9abaad/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:38:57.573070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0945266-732f-4566-9e6e-7608adcda76a None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:57.573356 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0945266-732f-4566-9e6e-7608adcda76a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:57.573662 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0945266-732f-4566-9e6e-7608adcda76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:57.591844 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e0945266-732f-4566-9e6e-7608adcda76a None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:57.593038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e0945266-732f-4566-9e6e-7608adcda76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:57.654105 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1064/2143] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:57.664364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49878847-0c12-4670-8151-71ecfe8d0927 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:57.666200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-49878847-0c12-4670-8151-71ecfe8d0927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:57.723852 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49878847-0c12-4670-8151-71ecfe8d0927 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:57.727587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04fedc-761b-4094-92cd-1ffb75eb651d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:57.728245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04fedc-761b-4094-92cd-1ffb75eb651d service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:57.728522 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04fedc-761b-4094-92cd-1ffb75eb651d service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:57.728794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04fedc-761b-4094-92cd-1ffb75eb651d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:57.739062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04fedc-761b-4094-92cd-1ffb75eb651d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:57.740502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04fedc-761b-4094-92cd-1ffb75eb651d service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:57.750322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1080/2144] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:38:58.673122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49634b2f-1a3e-4a62-83e7-865bbeb028c6 None None] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:58.674276 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49634b2f-1a3e-4a62-83e7-865bbeb028c6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:58.674602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49634b2f-1a3e-4a62-83e7-865bbeb028c6 None None] PATH_INFO: `/` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:58.676207 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1065/2145] 10.222.0.16 () {54 vars in 921 bytes} [Sun Aug 29 14:38:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 14:38:58.682542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d276e-9005-4caa-aada-5ae9278f5da8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:58.683544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d276e-9005-4caa-aada-5ae9278f5da8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:58.683888 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d276e-9005-4caa-aada-5ae9278f5da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:58.748495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-926d276e-9005-4caa-aada-5ae9278f5da8 None None] MFA Rules not processed for user `d8c0afa8f09f4923b9c8ab2696156129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:58.750187 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-926d276e-9005-4caa-aada-5ae9278f5da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:58.831966 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1081/2146] 10.222.0.16 () {58 vars in 1019 bytes} [Sun Aug 29 14:38:58 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:58.844583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49634b2f-1a3e-4a62-83e7-865bbeb028c6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:58.847465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-49634b2f-1a3e-4a62-83e7-865bbeb028c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:58.908432 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49634b2f-1a3e-4a62-83e7-865bbeb028c6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:58.912254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8368c4-27b1-4900-8737-75589494a4c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db83070471e34df695b571cdab440b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:58.912897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8368c4-27b1-4900-8737-75589494a4c8 service glance] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:58.913175 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8368c4-27b1-4900-8737-75589494a4c8 service glance] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:58.913445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8368c4-27b1-4900-8737-75589494a4c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:58.923974 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8368c4-27b1-4900-8737-75589494a4c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:58.925414 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8368c4-27b1-4900-8737-75589494a4c8 service glance] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:58.936616 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1066/2147] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:58 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:38:59.272659 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9e516-cee7-4041-a5b6-263e1bdbb050 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:59.272948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9e516-cee7-4041-a5b6-263e1bdbb050 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:59.273228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9e516-cee7-4041-a5b6-263e1bdbb050 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:59.275131 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1082/2148] 10.222.0.16 () {54 vars in 921 bytes} [Sun Aug 29 14:38:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:38:59.280034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad9529-d5cd-42c2-a5d1-2dfc4d887c38 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:59.280346 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad9529-d5cd-42c2-a5d1-2dfc4d887c38 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:59.280623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad9529-d5cd-42c2-a5d1-2dfc4d887c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:59.300194 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-67ad9529-d5cd-42c2-a5d1-2dfc4d887c38 None None] MFA Rules not processed for user `f13a39de23f04cb0a2f5b050d740334a`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:59.301390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-67ad9529-d5cd-42c2-a5d1-2dfc4d887c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:59.307820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1067/2149] 10.222.0.16 () {58 vars in 1019 bytes} [Sun Aug 29 14:38:59 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:38:59.320246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9e516-cee7-4041-a5b6-263e1bdbb050 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:59.352777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7ee9e516-cee7-4041-a5b6-263e1bdbb050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:59.352777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9e516-cee7-4041-a5b6-263e1bdbb050 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:59.352777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39682fa-2cca-486b-be81-64a368c021bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:59.353773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39682fa-2cca-486b-be81-64a368c021bb service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:59.353773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39682fa-2cca-486b-be81-64a368c021bb service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:59.353773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39682fa-2cca-486b-be81-64a368c021bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:59.353773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39682fa-2cca-486b-be81-64a368c021bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:59.353773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39682fa-2cca-486b-be81-64a368c021bb service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:59.358570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1083/2150] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:59 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:38:59.736282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95babf67-2096-4af0-911b-a03cbbf0220e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:59.736761 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95babf67-2096-4af0-911b-a03cbbf0220e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:59.736967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95babf67-2096-4af0-911b-a03cbbf0220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:59.771349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-95babf67-2096-4af0-911b-a03cbbf0220e None None] MFA Rules not processed for user `9f616dad20824b21927f4f6a2a9abaad`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:38:59.772875 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-95babf67-2096-4af0-911b-a03cbbf0220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:59.866110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1068/2151] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:38:59 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:38:59.875947 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39682fa-2cca-486b-be81-64a368c021bb service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:38:59.878007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c39682fa-2cca-486b-be81-64a368c021bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:38:59.957794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39682fa-2cca-486b-be81-64a368c021bb service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:38:59.961454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bd1a8-1dce-4e53-9379-bba4e048f5e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:38:59.962131 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bd1a8-1dce-4e53-9379-bba4e048f5e1 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:38:59.962417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bd1a8-1dce-4e53-9379-bba4e048f5e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:38:59.962693 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bd1a8-1dce-4e53-9379-bba4e048f5e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:38:59.971469 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bd1a8-1dce-4e53-9379-bba4e048f5e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:38:59.979664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bd1a8-1dce-4e53-9379-bba4e048f5e1 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:38:59.982200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1084/2152] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:38:59 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:39:01.996212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3790890-0db9-44bb-8d84-9ec8ffaa37ba None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:01.996710 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3790890-0db9-44bb-8d84-9ec8ffaa37ba None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:01.996811 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3790890-0db9-44bb-8d84-9ec8ffaa37ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:02.015131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c3790890-0db9-44bb-8d84-9ec8ffaa37ba None None] MFA Rules not processed for user `9f616dad20824b21927f4f6a2a9abaad`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:02.016410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c3790890-0db9-44bb-8d84-9ec8ffaa37ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:02.024051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1069/2153] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:01 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:03.909931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8776511-172e-48ab-a8d2-f5bf39a5e0c8 None None] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:03.910445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8776511-172e-48ab-a8d2-f5bf39a5e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:03.910530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8776511-172e-48ab-a8d2-f5bf39a5e0c8 None None] PATH_INFO: `/` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:03.912274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1085/2154] 10.222.0.16 () {54 vars in 960 bytes} [Sun Aug 29 14:39:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 14:39:03.918293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104797d-68dd-44be-b498-52f9b0258911 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:03.918780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104797d-68dd-44be-b498-52f9b0258911 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:03.919164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104797d-68dd-44be-b498-52f9b0258911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:03.990841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e104797d-68dd-44be-b498-52f9b0258911 None None] MFA Rules not processed for user `b77a408df11844e2aacbb366019dc3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:03.999494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e104797d-68dd-44be-b498-52f9b0258911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:04.066018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1070/2155] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Aug 29 14:39:03 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:04.072382 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8776511-172e-48ab-a8d2-f5bf39a5e0c8 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:04.086613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8776511-172e-48ab-a8d2-f5bf39a5e0c8 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:04.091515 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b0b48-c5fb-4af4-98f6-a6264cc90329 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77a408df11844e2aacbb366019dc3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:04.092140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0b48-c5fb-4af4-98f6-a6264cc90329 service placement] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:04.092418 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0b48-c5fb-4af4-98f6-a6264cc90329 service placement] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:04.092688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0b48-c5fb-4af4-98f6-a6264cc90329 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:04.094420 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b01b0b48-c5fb-4af4-98f6-a6264cc90329 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:04.102621 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104797d-68dd-44be-b498-52f9b0258911 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:04.104099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e104797d-68dd-44be-b498-52f9b0258911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:04.106641 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b0b48-c5fb-4af4-98f6-a6264cc90329 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:04.108198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b0b48-c5fb-4af4-98f6-a6264cc90329 service placement] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:04.116619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104797d-68dd-44be-b498-52f9b0258911 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:04.118302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1086/2156] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:39:04 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:39:04.121832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b465a74-c587-411d-a285-33f28f6f6434 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77a408df11844e2aacbb366019dc3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:04.122506 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b465a74-c587-411d-a285-33f28f6f6434 service placement] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:04.122787 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b465a74-c587-411d-a285-33f28f6f6434 service placement] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:04.123063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b465a74-c587-411d-a285-33f28f6f6434 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:04.132405 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b465a74-c587-411d-a285-33f28f6f6434 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:04.133924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b465a74-c587-411d-a285-33f28f6f6434 service placement] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:04.144033 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1071/2157] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:39:04 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:39:06.501549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac95abf-1849-4883-a7df-b9f52c0aa4d1 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:06.502136 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac95abf-1849-4883-a7df-b9f52c0aa4d1 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:06.502241 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac95abf-1849-4883-a7df-b9f52c0aa4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:06.527372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-4ac95abf-1849-4883-a7df-b9f52c0aa4d1 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:06.528965 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4ac95abf-1849-4883-a7df-b9f52c0aa4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:06.587713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1087/2158] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:39:06 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:06.601039 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b465a74-c587-411d-a285-33f28f6f6434 service placement] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:06.602542 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0b465a74-c587-411d-a285-33f28f6f6434 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:06.669757 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b465a74-c587-411d-a285-33f28f6f6434 service placement] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:06.676110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfebf73-b9b3-467d-8fee-5b7e96b806a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:06.676698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfebf73-b9b3-467d-8fee-5b7e96b806a2 service swift] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:06.676977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfebf73-b9b3-467d-8fee-5b7e96b806a2 service swift] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:06.677250 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfebf73-b9b3-467d-8fee-5b7e96b806a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:06.685698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfebf73-b9b3-467d-8fee-5b7e96b806a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:06.687318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfebf73-b9b3-467d-8fee-5b7e96b806a2 service swift] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:06.696513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1072/2159] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:39:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 14:39:08.295754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28aa377-3df0-4eee-b1a7-4e8ad424bcb0 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:08.296223 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28aa377-3df0-4eee-b1a7-4e8ad424bcb0 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:08.296312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28aa377-3df0-4eee-b1a7-4e8ad424bcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:08.313665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-a28aa377-3df0-4eee-b1a7-4e8ad424bcb0 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:08.314949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a28aa377-3df0-4eee-b1a7-4e8ad424bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:08.322356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1088/2160] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:39:08 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:08.336431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfebf73-b9b3-467d-8fee-5b7e96b806a2 service swift] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:08.347304 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfebf73-b9b3-467d-8fee-5b7e96b806a2 service swift] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:08.352956 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aedb39-2659-48c5-9435-2236bccede14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:08.353774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aedb39-2659-48c5-9435-2236bccede14 service swift] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:08.354093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aedb39-2659-48c5-9435-2236bccede14 service swift] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:08.354373 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aedb39-2659-48c5-9435-2236bccede14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:08.363313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aedb39-2659-48c5-9435-2236bccede14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:08.364981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aedb39-2659-48c5-9435-2236bccede14 service swift] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:08.374866 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1073/2161] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:39:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 14:39:08.388244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c2cf3-f18d-408a-a419-ce21096d4198 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:08.388541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c2cf3-f18d-408a-a419-ce21096d4198 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:08.388917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c2cf3-f18d-408a-a419-ce21096d4198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:08.410411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3b2c2cf3-f18d-408a-a419-ce21096d4198 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:08.411661 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3b2c2cf3-f18d-408a-a419-ce21096d4198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:08.418979 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1089/2162] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:39:08 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:08.433055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aedb39-2659-48c5-9435-2236bccede14 service swift] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:08.446525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aedb39-2659-48c5-9435-2236bccede14 service swift] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:08.451725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c58b75-1c46-44ec-a5cf-bea8d576591a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:08.452365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c58b75-1c46-44ec-a5cf-bea8d576591a service swift] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:08.452644 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c58b75-1c46-44ec-a5cf-bea8d576591a service swift] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:08.452920 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c58b75-1c46-44ec-a5cf-bea8d576591a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:08.462110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c58b75-1c46-44ec-a5cf-bea8d576591a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:08.463689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c58b75-1c46-44ec-a5cf-bea8d576591a service swift] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:08.472458 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1074/2163] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:39:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 14:39:09.276580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82391963-7dcb-486b-9076-00eae1f8dcf1 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:09.276874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82391963-7dcb-486b-9076-00eae1f8dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:09.277196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82391963-7dcb-486b-9076-00eae1f8dcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:09.297649 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-82391963-7dcb-486b-9076-00eae1f8dcf1 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:09.300279 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-82391963-7dcb-486b-9076-00eae1f8dcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:09.319512 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1090/2164] 10.222.0.16 () {58 vars in 968 bytes} [Sun Aug 29 14:39:09 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:39:09.355835 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c58b75-1c46-44ec-a5cf-bea8d576591a service swift] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:09.369372 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c58b75-1c46-44ec-a5cf-bea8d576591a service swift] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:09.375875 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6876f1-b00c-47ce-8aa7-24077f621f3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:09.377836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6876f1-b00c-47ce-8aa7-24077f621f3b service swift] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:09.378387 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6876f1-b00c-47ce-8aa7-24077f621f3b service swift] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:09.378812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6876f1-b00c-47ce-8aa7-24077f621f3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:09.388667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6876f1-b00c-47ce-8aa7-24077f621f3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:09.390486 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6876f1-b00c-47ce-8aa7-24077f621f3b service swift] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:09.400972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1075/2165] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:39:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 14:39:12.358181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82391963-7dcb-486b-9076-00eae1f8dcf1 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:12.359542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-82391963-7dcb-486b-9076-00eae1f8dcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:12.373894 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82391963-7dcb-486b-9076-00eae1f8dcf1 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:12.379194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:12.380037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:12.380316 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:12.380582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] PATH_INFO: `/v3/users/231c34bcbaed4a3ba4e13374f83cbb0a` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:12.381743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=231c34bcbaed4a3ba4e13374f83cbb0a)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:12.383660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:12.609054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231c34bcbaed4a3ba4e13374f83cbb0a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:12.610191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231c34bcbaed4a3ba4e13374f83cbb0a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:12.610945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231c34bcbaed4a3ba4e13374f83cbb0a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:12.892077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231c34bcbaed4a3ba4e13374f83cbb0a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:12.892077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231c34bcbaed4a3ba4e13374f83cbb0a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:12.901935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1091/2166] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:39:12 2021] DELETE /identity/v3/users/231c34bcbaed4a3ba4e13374f83cbb0a => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:12.906244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b864c6-291d-4c40-80d3-0cf76d32173c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:12.907129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b864c6-291d-4c40-80d3-0cf76d32173c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:12.907404 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b864c6-291d-4c40-80d3-0cf76d32173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:12.926904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-70b864c6-291d-4c40-80d3-0cf76d32173c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:12.928122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-70b864c6-291d-4c40-80d3-0cf76d32173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:12.995487 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1076/2167] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:39:13.006153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:13.007593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:13.069472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c505de-3ed1-4e67-bee4-122e247590bc admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:13.073591 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f301c-9609-47c9-9d9b-70cece29d1f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:13.074274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f301c-9609-47c9-9d9b-70cece29d1f7 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:13.074555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f301c-9609-47c9-9d9b-70cece29d1f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:13.074824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f301c-9609-47c9-9d9b-70cece29d1f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:13.086962 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f301c-9609-47c9-9d9b-70cece29d1f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:13.088744 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f301c-9609-47c9-9d9b-70cece29d1f7 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:13.100185 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1092/2168] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:39:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:39:13.869669 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b864c6-291d-4c40-80d3-0cf76d32173c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:13.869669 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-70b864c6-291d-4c40-80d3-0cf76d32173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:13.887639 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b864c6-291d-4c40-80d3-0cf76d32173c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:13.904967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:13.904967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:13.904967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:13.904967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] PATH_INFO: `/v3/projects/1f45ccabb8814c61a2d3fc688ec2205b` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:13.905455 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f45ccabb8814c61a2d3fc688ec2205b)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:13.905455 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:14.267800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f45ccabb8814c61a2d3fc688ec2205b', 'request_id': 'req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:14.341750 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f45ccabb8814c61a2d3fc688ec2205b', 'request_id': 'req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:14.350841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f45ccabb8814c61a2d3fc688ec2205b', 'request_id': 'req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:14.364523 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] The token cache is being invalidate because project 1f45ccabb8814c61a2d3fc688ec2205b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:39:14.364819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:14.365489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:14.367404 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1077/2169] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:39:13 2021] DELETE /identity/v3/projects/1f45ccabb8814c61a2d3fc688ec2205b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:32.156662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f301c-9609-47c9-9d9b-70cece29d1f7 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:32.158098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-190f301c-9609-47c9-9d9b-70cece29d1f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:32.173148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f301c-9609-47c9-9d9b-70cece29d1f7 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:32.228492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20db8d4-45a5-463d-b695-ebaef83cf3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:32.229271 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20db8d4-45a5-463d-b695-ebaef83cf3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:32.229549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20db8d4-45a5-463d-b695-ebaef83cf3de admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:32.229818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20db8d4-45a5-463d-b695-ebaef83cf3de admin admin] PATH_INFO: `/v3/users/f44dac86674e41b78375a51798ea0cc7` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:32.231034 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20db8d4-45a5-463d-b695-ebaef83cf3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=f44dac86674e41b78375a51798ea0cc7)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:32.232937 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20db8d4-45a5-463d-b695-ebaef83cf3de admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:32.431811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d20db8d4-45a5-463d-b695-ebaef83cf3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f44dac86674e41b78375a51798ea0cc7'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:32.432475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d20db8d4-45a5-463d-b695-ebaef83cf3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f44dac86674e41b78375a51798ea0cc7'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:32.433065 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d20db8d4-45a5-463d-b695-ebaef83cf3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f44dac86674e41b78375a51798ea0cc7'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:32.478907 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d20db8d4-45a5-463d-b695-ebaef83cf3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f44dac86674e41b78375a51798ea0cc7'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:32.492212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d20db8d4-45a5-463d-b695-ebaef83cf3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f44dac86674e41b78375a51798ea0cc7'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:32.506294 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1093/2170] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:39:32 2021] DELETE /identity/v3/users/f44dac86674e41b78375a51798ea0cc7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:39:32.801166 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:32.803190 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:32.824746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4fceb-679e-450a-a5c4-e46b3a42ad2d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:32.908851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:32.909728 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:32.910044 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:32.910323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf admin admin] PATH_INFO: `/v3/projects/cb6738c758b44604a7eb98cf8f592891` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:32.911660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6738c758b44604a7eb98cf8f592891)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:32.913589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:33.029981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6738c758b44604a7eb98cf8f592891', 'request_id': 'req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:33.141745 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6738c758b44604a7eb98cf8f592891', 'request_id': 'req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:33.147870 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6738c758b44604a7eb98cf8f592891', 'request_id': 'req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:33.159651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf admin admin] The token cache is being invalidate because project cb6738c758b44604a7eb98cf8f592891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:39:33.159934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:33.161015 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-46116f6d-ad17-43dd-bf8f-3ab6efae91bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:33.163462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1078/2171] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:39:32 2021] DELETE /identity/v3/projects/cb6738c758b44604a7eb98cf8f592891 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:33.171418 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62376de-8653-47be-89b5-87e09284cd43 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:33.172461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62376de-8653-47be-89b5-87e09284cd43 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:33.172899 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62376de-8653-47be-89b5-87e09284cd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:33.195743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b62376de-8653-47be-89b5-87e09284cd43 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:33.196924 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b62376de-8653-47be-89b5-87e09284cd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:33.265851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1094/2172] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:33.273738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6820-47ec-4741-bfd4-f36a8e36d19d None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:33.274152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6820-47ec-4741-bfd4-f36a8e36d19d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:33.274553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6820-47ec-4741-bfd4-f36a8e36d19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:33.303977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-4b1b6820-47ec-4741-bfd4-f36a8e36d19d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:33.303977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4b1b6820-47ec-4741-bfd4-f36a8e36d19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:33.313813 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1079/2173] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:33.318930 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62376de-8653-47be-89b5-87e09284cd43 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:33.332128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62376de-8653-47be-89b5-87e09284cd43 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:33.339074 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0d7a7-793f-4943-807a-9fd380529773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:33.339817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0d7a7-793f-4943-807a-9fd380529773 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:33.340321 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0d7a7-793f-4943-807a-9fd380529773 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:33.340615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0d7a7-793f-4943-807a-9fd380529773 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:33.341522 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0d7a7-793f-4943-807a-9fd380529773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:39:33.341823 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0d7a7-793f-4943-807a-9fd380529773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:33.343452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0d7a7-793f-4943-807a-9fd380529773 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:33.357269 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1095/2174] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:39:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:39:33.362652 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b6820-47ec-4741-bfd4-f36a8e36d19d None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:33.373169 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b6820-47ec-4741-bfd4-f36a8e36d19d None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:33.388746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ed822-985a-4d76-9a4a-582c962f0f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:33.388746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ed822-985a-4d76-9a4a-582c962f0f65 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:33.388746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ed822-985a-4d76-9a4a-582c962f0f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:33.388746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ed822-985a-4d76-9a4a-582c962f0f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:33.389137 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ed822-985a-4d76-9a4a-582c962f0f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:33.389137 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ed822-985a-4d76-9a4a-582c962f0f65 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:33.512301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1080/2175] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:39:33 2021] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:39:33.516418 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0d7a7-793f-4943-807a-9fd380529773 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:33.526793 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0d7a7-793f-4943-807a-9fd380529773 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:33.589701 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5a0a3-0cd4-4970-8efa-9d23a5f363a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:33.590421 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5a0a3-0cd4-4970-8efa-9d23a5f363a9 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:33.590702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5a0a3-0cd4-4970-8efa-9d23a5f363a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:33.590975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5a0a3-0cd4-4970-8efa-9d23a5f363a9 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:33.591667 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5a0a3-0cd4-4970-8efa-9d23a5f363a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:33.593581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5a0a3-0cd4-4970-8efa-9d23a5f363a9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:33.699290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1096/2176] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:39:33 2021] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:39:33.710909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ed822-985a-4d76-9a4a-582c962f0f65 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:33.721216 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ed822-985a-4d76-9a4a-582c962f0f65 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:33.726922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc9790-42d7-48bf-8161-3f4d4c679140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:33.727602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc9790-42d7-48bf-8161-3f4d4c679140 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:33.727882 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc9790-42d7-48bf-8161-3f4d4c679140 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:33.728153 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc9790-42d7-48bf-8161-3f4d4c679140 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:33.728870 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc9790-42d7-48bf-8161-3f4d4c679140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:33.730472 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc9790-42d7-48bf-8161-3f4d4c679140 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:33.740665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1081/2177] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:39:33.744472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5a0a3-0cd4-4970-8efa-9d23a5f363a9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:33.754157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5a0a3-0cd4-4970-8efa-9d23a5f363a9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:33.759612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94d9d0-115f-4e0f-9e10-7df2c4e935fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:33.760260 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94d9d0-115f-4e0f-9e10-7df2c4e935fc admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:33.760545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94d9d0-115f-4e0f-9e10-7df2c4e935fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:33.760820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94d9d0-115f-4e0f-9e10-7df2c4e935fc admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:33.761535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94d9d0-115f-4e0f-9e10-7df2c4e935fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:33.763150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94d9d0-115f-4e0f-9e10-7df2c4e935fc admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:33.774116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1097/2178] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:39:33.778717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc9790-42d7-48bf-8161-3f4d4c679140 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:33.789522 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc9790-42d7-48bf-8161-3f4d4c679140 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:33.794355 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc699ca9-d90b-42f0-9a18-ab5f0d5fa488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:33.795236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc699ca9-d90b-42f0-9a18-ab5f0d5fa488 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:33.795518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc699ca9-d90b-42f0-9a18-ab5f0d5fa488 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:33.795796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc699ca9-d90b-42f0-9a18-ab5f0d5fa488 admin admin] PATH_INFO: `/v3/projects/2deccf035b0549478a79dbc799030da6/users/2ddc7e1ea4254d2c9703e0be937707b8/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:33.812038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc699ca9-d90b-42f0-9a18-ab5f0d5fa488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2deccf035b0549478a79dbc799030da6, user_id=2ddc7e1ea4254d2c9703e0be937707b8, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:33.815364 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc699ca9-d90b-42f0-9a18-ab5f0d5fa488 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:33.818803 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2671d56-88ec-4000-a64a-488156d73856 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:33.819426 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2671d56-88ec-4000-a64a-488156d73856 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:33.820171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2671d56-88ec-4000-a64a-488156d73856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:33.869439 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-a2671d56-88ec-4000-a64a-488156d73856 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:33.870676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a2671d56-88ec-4000-a64a-488156d73856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:33.913306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1082/2179] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:39:33 2021] PUT /identity/v3/projects/2deccf035b0549478a79dbc799030da6/users/2ddc7e1ea4254d2c9703e0be937707b8/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:33.917084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bde72-7e2d-44f9-80ce-99d5b2298f29 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:33.932772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bde72-7e2d-44f9-80ce-99d5b2298f29 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:33.932772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bde72-7e2d-44f9-80ce-99d5b2298f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:33.938201 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1098/2180] 10.222.0.16 () {58 vars in 968 bytes} [Sun Aug 29 14:39:33 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:39:33.948154 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-2d9bde72-7e2d-44f9-80ce-99d5b2298f29 None None] MFA Rules not processed for user `2ddc7e1ea4254d2c9703e0be937707b8`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:33.949359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-2d9bde72-7e2d-44f9-80ce-99d5b2298f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:33.952635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2671d56-88ec-4000-a64a-488156d73856 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:33.954794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a2671d56-88ec-4000-a64a-488156d73856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:34.022765 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1083/2181] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:33 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:39:34.023677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bde72-7e2d-44f9-80ce-99d5b2298f29 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:34.066911 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2671d56-88ec-4000-a64a-488156d73856 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:34.103903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bde72-7e2d-44f9-80ce-99d5b2298f29 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:34.108524 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47998-da21-41f0-be90-2a6d11cd79fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:34.109075 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47998-da21-41f0-be90-2a6d11cd79fe admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:34.109582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47998-da21-41f0-be90-2a6d11cd79fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:34.109958 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47998-da21-41f0-be90-2a6d11cd79fe admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:34.110893 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b47998-da21-41f0-be90-2a6d11cd79fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:34.113129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b47998-da21-41f0-be90-2a6d11cd79fe admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:34.133367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92c881-0a0b-48db-8d8f-7eb3cf4cca22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:34.134059 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92c881-0a0b-48db-8d8f-7eb3cf4cca22 service swift] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:34.134344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92c881-0a0b-48db-8d8f-7eb3cf4cca22 service swift] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:34.134662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92c881-0a0b-48db-8d8f-7eb3cf4cca22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:34.189846 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92c881-0a0b-48db-8d8f-7eb3cf4cca22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:34.191452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92c881-0a0b-48db-8d8f-7eb3cf4cca22 service swift] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:34.199892 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1099/2182] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:39:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 14:39:34.244568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1084/2183] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:39:34 2021] POST /identity/v3/projects => generated 371 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:39:34.248516 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92c881-0a0b-48db-8d8f-7eb3cf4cca22 service swift] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:34.259540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92c881-0a0b-48db-8d8f-7eb3cf4cca22 service swift] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:34.313421 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12fc7d-e072-40bd-b2c4-690607a8016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:34.314029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12fc7d-e072-40bd-b2c4-690607a8016e admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:34.314309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12fc7d-e072-40bd-b2c4-690607a8016e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:34.314578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12fc7d-e072-40bd-b2c4-690607a8016e admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:34.315265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12fc7d-e072-40bd-b2c4-690607a8016e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:34.317220 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12fc7d-e072-40bd-b2c4-690607a8016e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:34.455967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1100/2184] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:39:34 2021] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:39:34.457252 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47998-da21-41f0-be90-2a6d11cd79fe admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:34.469000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47998-da21-41f0-be90-2a6d11cd79fe admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:34.476932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693dadb-448f-4a28-b61f-2655102a2fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:34.476932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693dadb-448f-4a28-b61f-2655102a2fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:34.476932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693dadb-448f-4a28-b61f-2655102a2fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:34.477302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693dadb-448f-4a28-b61f-2655102a2fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:34.478147 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693dadb-448f-4a28-b61f-2655102a2fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:34.479663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693dadb-448f-4a28-b61f-2655102a2fe5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:34.492326 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1085/2185] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:34 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:39:34.500112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12fc7d-e072-40bd-b2c4-690607a8016e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:34.509047 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12fc7d-e072-40bd-b2c4-690607a8016e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:34.520559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f14196-abc1-481a-b838-1c99edf87df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:34.522826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14196-abc1-481a-b838-1c99edf87df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:34.522826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14196-abc1-481a-b838-1c99edf87df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:34.522826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14196-abc1-481a-b838-1c99edf87df8 admin admin] PATH_INFO: `/v3/projects/a0dca21548d643f5a0f9116ac4bb44eb/users/0350d05620b14ba0b5ce9e4ec4b11e02/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:34.538939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f14196-abc1-481a-b838-1c99edf87df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0dca21548d643f5a0f9116ac4bb44eb, user_id=0350d05620b14ba0b5ce9e4ec4b11e02, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:34.541602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f14196-abc1-481a-b838-1c99edf87df8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:34.647744 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1101/2186] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:39:34 2021] PUT /identity/v3/projects/a0dca21548d643f5a0f9116ac4bb44eb/users/0350d05620b14ba0b5ce9e4ec4b11e02/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:34.652818 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693dadb-448f-4a28-b61f-2655102a2fe5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:34.662919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693dadb-448f-4a28-b61f-2655102a2fe5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:34.719006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d450f-77f8-4f87-81e0-68d82387ab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:34.719681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d450f-77f8-4f87-81e0-68d82387ab9b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:34.719966 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d450f-77f8-4f87-81e0-68d82387ab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:34.720298 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d450f-77f8-4f87-81e0-68d82387ab9b admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:34.720957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d450f-77f8-4f87-81e0-68d82387ab9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:34.722576 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d450f-77f8-4f87-81e0-68d82387ab9b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:34.732764 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1086/2187] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:34 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:39:34.737031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f14196-abc1-481a-b838-1c99edf87df8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:34.747269 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f14196-abc1-481a-b838-1c99edf87df8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:34.751997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d920b-6868-4c2b-95a7-1273286253df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:34.752888 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d920b-6868-4c2b-95a7-1273286253df admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:34.753168 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d920b-6868-4c2b-95a7-1273286253df admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:34.753440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d920b-6868-4c2b-95a7-1273286253df admin admin] PATH_INFO: `/v3/projects/a0dca21548d643f5a0f9116ac4bb44eb/users/0350d05620b14ba0b5ce9e4ec4b11e02/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:34.755903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d920b-6868-4c2b-95a7-1273286253df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0dca21548d643f5a0f9116ac4bb44eb, user_id=0350d05620b14ba0b5ce9e4ec4b11e02, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:34.758534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d920b-6868-4c2b-95a7-1273286253df admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:34.770206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1102/2188] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:39:34 2021] PUT /identity/v3/projects/a0dca21548d643f5a0f9116ac4bb44eb/users/0350d05620b14ba0b5ce9e4ec4b11e02/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:39:34.780909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a1bf-e1f5-4bbd-a3e2-30931fa54ba5 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:34.781206 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a1bf-e1f5-4bbd-a3e2-30931fa54ba5 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:34.781492 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a1bf-e1f5-4bbd-a3e2-30931fa54ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:34.807100 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-8b32a1bf-e1f5-4bbd-a3e2-30931fa54ba5 None None] MFA Rules not processed for user `0350d05620b14ba0b5ce9e4ec4b11e02`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:34.808306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8b32a1bf-e1f5-4bbd-a3e2-30931fa54ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:34.882802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1087/2189] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:34 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:34.893490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d920b-6868-4c2b-95a7-1273286253df admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:34.895284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-298d920b-6868-4c2b-95a7-1273286253df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:34.954559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d920b-6868-4c2b-95a7-1273286253df admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:34.958821 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da1a54-88a3-494d-9c44-a6c05347059f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:34.959466 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da1a54-88a3-494d-9c44-a6c05347059f service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:34.959744 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da1a54-88a3-494d-9c44-a6c05347059f service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:34.960042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da1a54-88a3-494d-9c44-a6c05347059f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:34.969108 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da1a54-88a3-494d-9c44-a6c05347059f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:34.970565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da1a54-88a3-494d-9c44-a6c05347059f service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:34.980869 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1103/2190] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:39:34 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:39:35.276447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32a1bf-e1f5-4bbd-a3e2-30931fa54ba5 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:35.285993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32a1bf-e1f5-4bbd-a3e2-30931fa54ba5 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:35.290848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8d1a2-f3ab-4b7a-a32d-4163d2836749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:35.291496 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8d1a2-f3ab-4b7a-a32d-4163d2836749 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:35.291778 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8d1a2-f3ab-4b7a-a32d-4163d2836749 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:35.292757 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8d1a2-f3ab-4b7a-a32d-4163d2836749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:35.355548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8d1a2-f3ab-4b7a-a32d-4163d2836749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:35.359534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8d1a2-f3ab-4b7a-a32d-4163d2836749 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:35.366467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1088/2191] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:39:35 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:39:49.238255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da1a54-88a3-494d-9c44-a6c05347059f service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:49.239792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-54da1a54-88a3-494d-9c44-a6c05347059f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:49.304179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da1a54-88a3-494d-9c44-a6c05347059f service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:49.309001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02593d-df40-4a30-8acf-152abf2f247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:49.309881 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02593d-df40-4a30-8acf-152abf2f247c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:49.310186 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02593d-df40-4a30-8acf-152abf2f247c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:49.310462 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02593d-df40-4a30-8acf-152abf2f247c admin admin] PATH_INFO: `/v3/users/569387965b184cc3a1bc2aecdbede0cb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:49.311722 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02593d-df40-4a30-8acf-152abf2f247c admin admin] RBAC: Authorizing `identity:delete_user(user_id=569387965b184cc3a1bc2aecdbede0cb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:49.313692 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02593d-df40-4a30-8acf-152abf2f247c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:49.539231 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1f02593d-df40-4a30-8acf-152abf2f247c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569387965b184cc3a1bc2aecdbede0cb'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:49.539883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1f02593d-df40-4a30-8acf-152abf2f247c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569387965b184cc3a1bc2aecdbede0cb'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:49.540485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1f02593d-df40-4a30-8acf-152abf2f247c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569387965b184cc3a1bc2aecdbede0cb'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:49.633627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1f02593d-df40-4a30-8acf-152abf2f247c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569387965b184cc3a1bc2aecdbede0cb'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:49.645797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1f02593d-df40-4a30-8acf-152abf2f247c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569387965b184cc3a1bc2aecdbede0cb'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:49.658046 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1104/2192] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:39:49 2021] DELETE /identity/v3/users/569387965b184cc3a1bc2aecdbede0cb => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:49.903483 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8d1a2-f3ab-4b7a-a32d-4163d2836749 service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:49.914868 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8d1a2-f3ab-4b7a-a32d-4163d2836749 service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:49.969771 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e27e1b-f867-4fef-933e-db155196f129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:49.975788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e27e1b-f867-4fef-933e-db155196f129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:49.975788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e27e1b-f867-4fef-933e-db155196f129 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:49.975788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e27e1b-f867-4fef-933e-db155196f129 admin admin] PATH_INFO: `/v3/projects/f47de2d93f9f4dccbc3c75e56e117b44` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:49.975788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e27e1b-f867-4fef-933e-db155196f129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47de2d93f9f4dccbc3c75e56e117b44)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:49.975788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e27e1b-f867-4fef-933e-db155196f129 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:50.092086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-13e27e1b-f867-4fef-933e-db155196f129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47de2d93f9f4dccbc3c75e56e117b44', 'request_id': 'req-13e27e1b-f867-4fef-933e-db155196f129'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:50.207069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-13e27e1b-f867-4fef-933e-db155196f129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47de2d93f9f4dccbc3c75e56e117b44', 'request_id': 'req-13e27e1b-f867-4fef-933e-db155196f129'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:50.213628 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-13e27e1b-f867-4fef-933e-db155196f129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47de2d93f9f4dccbc3c75e56e117b44', 'request_id': 'req-13e27e1b-f867-4fef-933e-db155196f129'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:50.225967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-13e27e1b-f867-4fef-933e-db155196f129 admin admin] The token cache is being invalidate because project f47de2d93f9f4dccbc3c75e56e117b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:39:50.226220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-13e27e1b-f867-4fef-933e-db155196f129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:50.226861 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-13e27e1b-f867-4fef-933e-db155196f129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:50.228476 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1089/2193] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:39:49 2021] DELETE /identity/v3/projects/f47de2d93f9f4dccbc3c75e56e117b44 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:50.234482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a568c-1210-4070-aea1-dc5cdbdcefdd None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:50.234777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a568c-1210-4070-aea1-dc5cdbdcefdd None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:50.235058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a568c-1210-4070-aea1-dc5cdbdcefdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:50.252758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-085a568c-1210-4070-aea1-dc5cdbdcefdd None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:50.253983 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-085a568c-1210-4070-aea1-dc5cdbdcefdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:50.311118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1105/2194] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:50.318992 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dfc4d-3c9a-4dd2-a099-ebdafeb43df5 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:50.319286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dfc4d-3c9a-4dd2-a099-ebdafeb43df5 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:50.324238 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dfc4d-3c9a-4dd2-a099-ebdafeb43df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:50.338537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-577dfc4d-3c9a-4dd2-a099-ebdafeb43df5 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:50.339738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-577dfc4d-3c9a-4dd2-a099-ebdafeb43df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:50.351319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1090/2195] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:50.352936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a568c-1210-4070-aea1-dc5cdbdcefdd None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:50.362509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a568c-1210-4070-aea1-dc5cdbdcefdd None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:50.367407 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eb877-3849-4adc-a78d-9c5382fc75fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:50.368049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eb877-3849-4adc-a78d-9c5382fc75fe admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:50.368327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eb877-3849-4adc-a78d-9c5382fc75fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:50.368599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eb877-3849-4adc-a78d-9c5382fc75fe admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:50.369418 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eb877-3849-4adc-a78d-9c5382fc75fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:39:50.369720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eb877-3849-4adc-a78d-9c5382fc75fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:50.371327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eb877-3849-4adc-a78d-9c5382fc75fe admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:50.382884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1106/2196] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:39:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:39:50.387066 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dfc4d-3c9a-4dd2-a099-ebdafeb43df5 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:50.395954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dfc4d-3c9a-4dd2-a099-ebdafeb43df5 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:50.401209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720c233-24d6-4cc7-8793-1d7a7f61f01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:50.401839 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720c233-24d6-4cc7-8793-1d7a7f61f01a admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:50.402143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720c233-24d6-4cc7-8793-1d7a7f61f01a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:50.402410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720c233-24d6-4cc7-8793-1d7a7f61f01a admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:50.403113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720c233-24d6-4cc7-8793-1d7a7f61f01a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:50.405422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720c233-24d6-4cc7-8793-1d7a7f61f01a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:50.515629 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1091/2197] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:39:50 2021] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:39:50.519811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eb877-3849-4adc-a78d-9c5382fc75fe admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:50.529640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eb877-3849-4adc-a78d-9c5382fc75fe admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:50.583960 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d64a4-a486-492d-80d2-16f9389cd9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:50.584660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d64a4-a486-492d-80d2-16f9389cd9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:50.584931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d64a4-a486-492d-80d2-16f9389cd9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:50.585209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d64a4-a486-492d-80d2-16f9389cd9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:50.585933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d64a4-a486-492d-80d2-16f9389cd9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:50.587887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d64a4-a486-492d-80d2-16f9389cd9d5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:50.697062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1107/2198] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:39:50 2021] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:39:50.701423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720c233-24d6-4cc7-8793-1d7a7f61f01a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:50.712163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720c233-24d6-4cc7-8793-1d7a7f61f01a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:50.716863 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00582c-e34b-4352-b98e-4c8376e445a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:50.717553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00582c-e34b-4352-b98e-4c8376e445a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:50.717835 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00582c-e34b-4352-b98e-4c8376e445a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:50.723550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00582c-e34b-4352-b98e-4c8376e445a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:50.723550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00582c-e34b-4352-b98e-4c8376e445a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:50.723550 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00582c-e34b-4352-b98e-4c8376e445a7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:50.733520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1092/2199] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:50 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:39:50.737534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d64a4-a486-492d-80d2-16f9389cd9d5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:50.748156 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d64a4-a486-492d-80d2-16f9389cd9d5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:50.754612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5c7d0-4d84-4452-95b9-b2dd8a266a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:50.755287 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c7d0-4d84-4452-95b9-b2dd8a266a1e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:50.756128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c7d0-4d84-4452-95b9-b2dd8a266a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:50.756128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c7d0-4d84-4452-95b9-b2dd8a266a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:50.757262 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5c7d0-4d84-4452-95b9-b2dd8a266a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:50.758410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5c7d0-4d84-4452-95b9-b2dd8a266a1e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:50.770495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1108/2200] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:39:50.773428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00582c-e34b-4352-b98e-4c8376e445a7 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:50.783641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00582c-e34b-4352-b98e-4c8376e445a7 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:50.788763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83701c0e-2725-4855-a959-1cd7988e7595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:50.789629 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83701c0e-2725-4855-a959-1cd7988e7595 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:50.789939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83701c0e-2725-4855-a959-1cd7988e7595 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:50.790240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83701c0e-2725-4855-a959-1cd7988e7595 admin admin] PATH_INFO: `/v3/projects/204c86c6dd4048c5a3b9d4f7a78d69eb/users/51e73e926e064d0882dc443dfecdc542/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:50.804692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83701c0e-2725-4855-a959-1cd7988e7595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=204c86c6dd4048c5a3b9d4f7a78d69eb, user_id=51e73e926e064d0882dc443dfecdc542, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:50.807353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83701c0e-2725-4855-a959-1cd7988e7595 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:50.886572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1093/2201] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:39:50 2021] PUT /identity/v3/projects/204c86c6dd4048c5a3b9d4f7a78d69eb/users/51e73e926e064d0882dc443dfecdc542/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:50.891315 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c0a0-b47e-41d2-89ac-de00b407bbbc None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:50.891660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c0a0-b47e-41d2-89ac-de00b407bbbc None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:50.892109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c0a0-b47e-41d2-89ac-de00b407bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:50.918842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3ee8c0a0-b47e-41d2-89ac-de00b407bbbc None None] MFA Rules not processed for user `51e73e926e064d0882dc443dfecdc542`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:50.920075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3ee8c0a0-b47e-41d2-89ac-de00b407bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:50.989632 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1109/2202] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:50 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:51.000646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83701c0e-2725-4855-a959-1cd7988e7595 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:51.002645 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-83701c0e-2725-4855-a959-1cd7988e7595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:51.073770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83701c0e-2725-4855-a959-1cd7988e7595 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:51.079457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97bbea-05c7-4eb5-9841-52f29fdcd2c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:51.080087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97bbea-05c7-4eb5-9841-52f29fdcd2c2 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:51.080363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97bbea-05c7-4eb5-9841-52f29fdcd2c2 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:51.080632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97bbea-05c7-4eb5-9841-52f29fdcd2c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:51.088889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97bbea-05c7-4eb5-9841-52f29fdcd2c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:51.090483 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97bbea-05c7-4eb5-9841-52f29fdcd2c2 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:51.100307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1094/2203] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:39:50 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:39:51.289840 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c0a0-b47e-41d2-89ac-de00b407bbbc None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:51.352887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c0a0-b47e-41d2-89ac-de00b407bbbc None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:51.359183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:51.359183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:51.359183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:51.359183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] PATH_INFO: `/v3/users/51e73e926e064d0882dc443dfecdc542` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:51.360194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e73e926e064d0882dc443dfecdc542)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:51.362124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:51.622754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e73e926e064d0882dc443dfecdc542'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:51.623429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e73e926e064d0882dc443dfecdc542'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:51.624043 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e73e926e064d0882dc443dfecdc542'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:51.742148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e73e926e064d0882dc443dfecdc542'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:51.754439 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e73e926e064d0882dc443dfecdc542'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:51.766553 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1110/2204] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:39:51 2021] DELETE /identity/v3/users/51e73e926e064d0882dc443dfecdc542 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:51.771076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39f087-384b-4f01-a394-98062d8613ff None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:51.771394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39f087-384b-4f01-a394-98062d8613ff None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:51.772254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39f087-384b-4f01-a394-98062d8613ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:51.790448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-5f39f087-384b-4f01-a394-98062d8613ff None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:51.791641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5f39f087-384b-4f01-a394-98062d8613ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:51.850177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1095/2205] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:51.860654 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:51.862371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:51.919299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218befb-8caf-4e4d-8fb7-f1625550d486 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:51.924019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740680f0-a0a9-418c-9656-c37a6a7f6a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:51.924542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740680f0-a0a9-418c-9656-c37a6a7f6a7b service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:51.924857 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740680f0-a0a9-418c-9656-c37a6a7f6a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:51.925265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740680f0-a0a9-418c-9656-c37a6a7f6a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:51.935999 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740680f0-a0a9-418c-9656-c37a6a7f6a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:51.937810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740680f0-a0a9-418c-9656-c37a6a7f6a7b service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:51.949344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1111/2206] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:39:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:39:52.389576 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39f087-384b-4f01-a394-98062d8613ff None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:52.391248 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5f39f087-384b-4f01-a394-98062d8613ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:52.404007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39f087-384b-4f01-a394-98062d8613ff None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:52.408687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ede43-3196-4798-9895-67bf3cae7087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:52.409575 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ede43-3196-4798-9895-67bf3cae7087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:52.409848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ede43-3196-4798-9895-67bf3cae7087 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:52.410442 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ede43-3196-4798-9895-67bf3cae7087 admin admin] PATH_INFO: `/v3/projects/204c86c6dd4048c5a3b9d4f7a78d69eb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:52.411830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ede43-3196-4798-9895-67bf3cae7087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=204c86c6dd4048c5a3b9d4f7a78d69eb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:52.414431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ede43-3196-4798-9895-67bf3cae7087 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:52.498007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-167ede43-3196-4798-9895-67bf3cae7087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204c86c6dd4048c5a3b9d4f7a78d69eb', 'request_id': 'req-167ede43-3196-4798-9895-67bf3cae7087'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:52.567133 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-167ede43-3196-4798-9895-67bf3cae7087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204c86c6dd4048c5a3b9d4f7a78d69eb', 'request_id': 'req-167ede43-3196-4798-9895-67bf3cae7087'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:52.573025 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-167ede43-3196-4798-9895-67bf3cae7087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204c86c6dd4048c5a3b9d4f7a78d69eb', 'request_id': 'req-167ede43-3196-4798-9895-67bf3cae7087'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:52.585598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-167ede43-3196-4798-9895-67bf3cae7087 admin admin] The token cache is being invalidate because project 204c86c6dd4048c5a3b9d4f7a78d69eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:39:52.585924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-167ede43-3196-4798-9895-67bf3cae7087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:52.586621 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-167ede43-3196-4798-9895-67bf3cae7087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:52.588167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1096/2207] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:39:52 2021] DELETE /identity/v3/projects/204c86c6dd4048c5a3b9d4f7a78d69eb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:52.593995 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a516b-2a19-4668-9cbd-1c1a503e76d1 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:52.594453 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a516b-2a19-4668-9cbd-1c1a503e76d1 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:52.594709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a516b-2a19-4668-9cbd-1c1a503e76d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:52.613611 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b77a516b-2a19-4668-9cbd-1c1a503e76d1 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:52.614904 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b77a516b-2a19-4668-9cbd-1c1a503e76d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:52.674644 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1112/2208] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:52.683154 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5648f-cafe-41b8-bf29-fe7ad19248b9 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:52.683439 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5648f-cafe-41b8-bf29-fe7ad19248b9 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:52.691648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5648f-cafe-41b8-bf29-fe7ad19248b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:52.703675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-74f5648f-cafe-41b8-bf29-fe7ad19248b9 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:52.704984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-74f5648f-cafe-41b8-bf29-fe7ad19248b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:52.722749 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1097/2209] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:52.727464 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a516b-2a19-4668-9cbd-1c1a503e76d1 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:52.737699 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a516b-2a19-4668-9cbd-1c1a503e76d1 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:52.743209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a764e3-32e7-4b95-8b64-ab8ae67156a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:52.743979 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a764e3-32e7-4b95-8b64-ab8ae67156a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:52.744320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a764e3-32e7-4b95-8b64-ab8ae67156a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:52.744657 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a764e3-32e7-4b95-8b64-ab8ae67156a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:52.745547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a764e3-32e7-4b95-8b64-ab8ae67156a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:39:52.745939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a764e3-32e7-4b95-8b64-ab8ae67156a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:52.747568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a764e3-32e7-4b95-8b64-ab8ae67156a5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:52.759966 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1113/2210] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:39:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:39:52.764469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5648f-cafe-41b8-bf29-fe7ad19248b9 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:52.773719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5648f-cafe-41b8-bf29-fe7ad19248b9 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:52.778514 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1767988-89f3-4096-bd53-7b6ab2a38e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:52.779256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1767988-89f3-4096-bd53-7b6ab2a38e3b admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:52.779530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1767988-89f3-4096-bd53-7b6ab2a38e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:52.779799 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1767988-89f3-4096-bd53-7b6ab2a38e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:52.780484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1767988-89f3-4096-bd53-7b6ab2a38e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:52.782457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1767988-89f3-4096-bd53-7b6ab2a38e3b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:52.859391 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1098/2211] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:39:52 2021] POST /identity/v3/projects => generated 403 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:39:52.860575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a764e3-32e7-4b95-8b64-ab8ae67156a5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:52.871437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a764e3-32e7-4b95-8b64-ab8ae67156a5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:52.926733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d992c-79b9-43e9-9544-280e9876010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:52.927398 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d992c-79b9-43e9-9544-280e9876010d admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:52.927683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d992c-79b9-43e9-9544-280e9876010d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:52.928499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d992c-79b9-43e9-9544-280e9876010d admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:52.929212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d992c-79b9-43e9-9544-280e9876010d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:52.931129 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d992c-79b9-43e9-9544-280e9876010d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:53.033791 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1114/2212] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:39:52 2021] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:39:53.037980 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1767988-89f3-4096-bd53-7b6ab2a38e3b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:53.048118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1767988-89f3-4096-bd53-7b6ab2a38e3b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:53.054056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97d809-959a-4052-a818-b30b11a57578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:53.054726 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97d809-959a-4052-a818-b30b11a57578 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:53.055009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97d809-959a-4052-a818-b30b11a57578 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:53.055285 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97d809-959a-4052-a818-b30b11a57578 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:53.056041 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97d809-959a-4052-a818-b30b11a57578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:53.060883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97d809-959a-4052-a818-b30b11a57578 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:53.068951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1099/2213] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:39:53.073536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d992c-79b9-43e9-9544-280e9876010d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:53.083713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d992c-79b9-43e9-9544-280e9876010d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:53.089835 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d044ad-14bb-485d-9299-ba2155f54d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:53.090720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d044ad-14bb-485d-9299-ba2155f54d17 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:53.090924 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d044ad-14bb-485d-9299-ba2155f54d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:53.091206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d044ad-14bb-485d-9299-ba2155f54d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:53.091945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d044ad-14bb-485d-9299-ba2155f54d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:53.093534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d044ad-14bb-485d-9299-ba2155f54d17 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:53.105154 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1115/2214] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:39:53.109289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97d809-959a-4052-a818-b30b11a57578 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:53.119535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97d809-959a-4052-a818-b30b11a57578 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:53.124378 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d85323-58fd-4547-9d43-3e768084e82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:53.125315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d85323-58fd-4547-9d43-3e768084e82f admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:53.132023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d85323-58fd-4547-9d43-3e768084e82f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:53.132023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d85323-58fd-4547-9d43-3e768084e82f admin admin] PATH_INFO: `/v3/projects/3c68a42b8d5a4519a873748fe7a2a00f/users/239217f9a6334c48b5c09287e7a09b52/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:53.140846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d85323-58fd-4547-9d43-3e768084e82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c68a42b8d5a4519a873748fe7a2a00f, user_id=239217f9a6334c48b5c09287e7a09b52, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:53.143507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d85323-58fd-4547-9d43-3e768084e82f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:53.278067 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1100/2215] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:39:53 2021] PUT /identity/v3/projects/3c68a42b8d5a4519a873748fe7a2a00f/users/239217f9a6334c48b5c09287e7a09b52/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:53.284928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b744b2-72cd-496b-be76-2ca6f71f2d13 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:53.285297 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b744b2-72cd-496b-be76-2ca6f71f2d13 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:53.285696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b744b2-72cd-496b-be76-2ca6f71f2d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:53.312901 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-e4b744b2-72cd-496b-be76-2ca6f71f2d13 None None] MFA Rules not processed for user `239217f9a6334c48b5c09287e7a09b52`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:53.314179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e4b744b2-72cd-496b-be76-2ca6f71f2d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:53.380800 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1116/2216] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:53 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:53.385445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d85323-58fd-4547-9d43-3e768084e82f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:53.444144 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d85323-58fd-4547-9d43-3e768084e82f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:53.448960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb19eb-ca91-422a-928d-6d869b77601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:53.449634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb19eb-ca91-422a-928d-6d869b77601d admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:53.449957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb19eb-ca91-422a-928d-6d869b77601d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:53.450238 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb19eb-ca91-422a-928d-6d869b77601d admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:53.450937 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb19eb-ca91-422a-928d-6d869b77601d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:53.452828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb19eb-ca91-422a-928d-6d869b77601d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:53.532327 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1101/2217] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:39:53 2021] POST /identity/v3/projects => generated 405 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:39:53.538338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b744b2-72cd-496b-be76-2ca6f71f2d13 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:53.549518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b744b2-72cd-496b-be76-2ca6f71f2d13 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:53.603656 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2467a2-11a4-4859-bf3c-04179af7c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:53.604261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2467a2-11a4-4859-bf3c-04179af7c15b admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:53.604510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2467a2-11a4-4859-bf3c-04179af7c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:53.604782 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2467a2-11a4-4859-bf3c-04179af7c15b admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:53.605456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2467a2-11a4-4859-bf3c-04179af7c15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:53.607403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2467a2-11a4-4859-bf3c-04179af7c15b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:53.702018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1117/2218] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:39:53 2021] POST /identity/v3/users => generated 309 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:39:53.706155 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb19eb-ca91-422a-928d-6d869b77601d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:53.716853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb19eb-ca91-422a-928d-6d869b77601d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:53.721749 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398da67-b0c4-457d-96c3-dfdb1baa351a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:53.722449 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398da67-b0c4-457d-96c3-dfdb1baa351a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:53.722755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398da67-b0c4-457d-96c3-dfdb1baa351a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:53.723031 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398da67-b0c4-457d-96c3-dfdb1baa351a admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:53.723750 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398da67-b0c4-457d-96c3-dfdb1baa351a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:53.725930 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398da67-b0c4-457d-96c3-dfdb1baa351a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:53.736326 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1102/2219] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:39:53.749147 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2467a2-11a4-4859-bf3c-04179af7c15b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:53.759520 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2467a2-11a4-4859-bf3c-04179af7c15b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:53.764252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554cdef-0acf-4030-827a-46e257b34ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:53.765116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554cdef-0acf-4030-827a-46e257b34ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:53.765395 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554cdef-0acf-4030-827a-46e257b34ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:53.765670 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554cdef-0acf-4030-827a-46e257b34ff7 admin admin] PATH_INFO: `/v3/projects/ed4f5fbca10d47d79aa0af5f30ec354f/users/259ea2c1e8aa41009f658a2e166602a1/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:53.780958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554cdef-0acf-4030-827a-46e257b34ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4f5fbca10d47d79aa0af5f30ec354f, user_id=259ea2c1e8aa41009f658a2e166602a1, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:53.783634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554cdef-0acf-4030-827a-46e257b34ff7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:53.885481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1118/2220] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:39:53 2021] PUT /identity/v3/projects/ed4f5fbca10d47d79aa0af5f30ec354f/users/259ea2c1e8aa41009f658a2e166602a1/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:39:53.889295 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398da67-b0c4-457d-96c3-dfdb1baa351a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:53.899222 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398da67-b0c4-457d-96c3-dfdb1baa351a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:53.953542 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fce678-2d74-4ade-a6fd-ed369ea635b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:53.954249 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fce678-2d74-4ade-a6fd-ed369ea635b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:53.954531 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fce678-2d74-4ade-a6fd-ed369ea635b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:53.954805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fce678-2d74-4ade-a6fd-ed369ea635b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:53.955520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fce678-2d74-4ade-a6fd-ed369ea635b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:53.957187 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fce678-2d74-4ade-a6fd-ed369ea635b6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:53.967665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1103/2221] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:53 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:39:53.971918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554cdef-0acf-4030-827a-46e257b34ff7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:53.983390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554cdef-0acf-4030-827a-46e257b34ff7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:53.987811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14400329-483a-4d12-9eda-894d6b0ab667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:53.988682 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14400329-483a-4d12-9eda-894d6b0ab667 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:53.988958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14400329-483a-4d12-9eda-894d6b0ab667 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:53.989226 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14400329-483a-4d12-9eda-894d6b0ab667 admin admin] PATH_INFO: `/v3/projects/ed4f5fbca10d47d79aa0af5f30ec354f/users/259ea2c1e8aa41009f658a2e166602a1/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:53.991755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14400329-483a-4d12-9eda-894d6b0ab667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4f5fbca10d47d79aa0af5f30ec354f, user_id=259ea2c1e8aa41009f658a2e166602a1, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:53.994414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14400329-483a-4d12-9eda-894d6b0ab667 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:54.004412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1119/2222] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:39:53 2021] PUT /identity/v3/projects/ed4f5fbca10d47d79aa0af5f30ec354f/users/259ea2c1e8aa41009f658a2e166602a1/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:54.015623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ae889-503b-4424-bf92-003c7d032c9e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:54.015906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ae889-503b-4424-bf92-003c7d032c9e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:54.016177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ae889-503b-4424-bf92-003c7d032c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:54.042669 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-a86ae889-503b-4424-bf92-003c7d032c9e None None] MFA Rules not processed for user `259ea2c1e8aa41009f658a2e166602a1`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:54.043889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a86ae889-503b-4424-bf92-003c7d032c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:54.107407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1104/2223] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:54 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:54.117986 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14400329-483a-4d12-9eda-894d6b0ab667 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:54.120733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-14400329-483a-4d12-9eda-894d6b0ab667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:54.186518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14400329-483a-4d12-9eda-894d6b0ab667 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:54.190452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26d726-8c8f-49fb-8485-755603d9cf2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:54.191165 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26d726-8c8f-49fb-8485-755603d9cf2a service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:54.191452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26d726-8c8f-49fb-8485-755603d9cf2a service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:54.191754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26d726-8c8f-49fb-8485-755603d9cf2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:54.202308 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26d726-8c8f-49fb-8485-755603d9cf2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:54.203760 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26d726-8c8f-49fb-8485-755603d9cf2a service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:54.214638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1120/2224] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:39:54 2021] GET /identity/v3/auth/tokens => generated 3492 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:39:54.357196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ae889-503b-4424-bf92-003c7d032c9e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:54.417802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ae889-503b-4424-bf92-003c7d032c9e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:54.422279 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:54.423142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:54.423447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:54.423715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] PATH_INFO: `/v3/users/239217f9a6334c48b5c09287e7a09b52` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:54.424889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=239217f9a6334c48b5c09287e7a09b52)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:54.427018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:54.710449 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '239217f9a6334c48b5c09287e7a09b52'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:54.711082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '239217f9a6334c48b5c09287e7a09b52'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:54.717637 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '239217f9a6334c48b5c09287e7a09b52'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:54.784127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '239217f9a6334c48b5c09287e7a09b52'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:54.796870 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '239217f9a6334c48b5c09287e7a09b52'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:54.803749 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1105/2225] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:39:54 2021] DELETE /identity/v3/users/239217f9a6334c48b5c09287e7a09b52 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:54.808375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08d547-5070-4755-b93f-c4d953b5c7bd None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:54.810844 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08d547-5070-4755-b93f-c4d953b5c7bd None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:54.810844 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08d547-5070-4755-b93f-c4d953b5c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:54.826199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-ef08d547-5070-4755-b93f-c4d953b5c7bd None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:54.827461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ef08d547-5070-4755-b93f-c4d953b5c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:54.884980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1121/2226] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:54.897918 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:54.899341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:54.954390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb79ed-1416-4a0a-91a0-21e26d423867 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:54.958062 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f050f8-fa94-46fb-84b1-f61131239f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:54.958708 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f050f8-fa94-46fb-84b1-f61131239f6f service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:54.958988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f050f8-fa94-46fb-84b1-f61131239f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:54.959769 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f050f8-fa94-46fb-84b1-f61131239f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:54.970109 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f050f8-fa94-46fb-84b1-f61131239f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:54.971542 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f050f8-fa94-46fb-84b1-f61131239f6f service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:54.982604 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1106/2227] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:39:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:39:55.411582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08d547-5070-4755-b93f-c4d953b5c7bd None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:55.413506 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ef08d547-5070-4755-b93f-c4d953b5c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:55.425720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08d547-5070-4755-b93f-c4d953b5c7bd None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:55.432198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:55.433080 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:55.433341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:55.433615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] PATH_INFO: `/v3/projects/3c68a42b8d5a4519a873748fe7a2a00f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:55.439380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c68a42b8d5a4519a873748fe7a2a00f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:55.441763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:55.566442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c68a42b8d5a4519a873748fe7a2a00f', 'request_id': 'req-1515121d-2413-4194-948d-aca8d3b9a260'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:55.690396 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c68a42b8d5a4519a873748fe7a2a00f', 'request_id': 'req-1515121d-2413-4194-948d-aca8d3b9a260'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:55.696209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c68a42b8d5a4519a873748fe7a2a00f', 'request_id': 'req-1515121d-2413-4194-948d-aca8d3b9a260'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:55.707960 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] The token cache is being invalidate because project 3c68a42b8d5a4519a873748fe7a2a00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:39:55.708241 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:55.708853 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:55.710994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1122/2228] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:39:55 2021] DELETE /identity/v3/projects/3c68a42b8d5a4519a873748fe7a2a00f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:55.715055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f050f8-fa94-46fb-84b1-f61131239f6f service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:55.730995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f050f8-fa94-46fb-84b1-f61131239f6f service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:55.785076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79615618-9a21-4032-bf9a-16c2eee91218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:55.785957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79615618-9a21-4032-bf9a-16c2eee91218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:55.786237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79615618-9a21-4032-bf9a-16c2eee91218 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:55.786622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79615618-9a21-4032-bf9a-16c2eee91218 admin admin] PATH_INFO: `/v3/users/259ea2c1e8aa41009f658a2e166602a1` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:55.787770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79615618-9a21-4032-bf9a-16c2eee91218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=259ea2c1e8aa41009f658a2e166602a1)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:55.789656 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79615618-9a21-4032-bf9a-16c2eee91218 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:55.966587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-79615618-9a21-4032-bf9a-16c2eee91218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259ea2c1e8aa41009f658a2e166602a1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:55.967238 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-79615618-9a21-4032-bf9a-16c2eee91218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259ea2c1e8aa41009f658a2e166602a1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:55.973734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-79615618-9a21-4032-bf9a-16c2eee91218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259ea2c1e8aa41009f658a2e166602a1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:56.061564 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-79615618-9a21-4032-bf9a-16c2eee91218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259ea2c1e8aa41009f658a2e166602a1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:56.073278 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-79615618-9a21-4032-bf9a-16c2eee91218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259ea2c1e8aa41009f658a2e166602a1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:56.079004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1107/2229] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:39:55 2021] DELETE /identity/v3/users/259ea2c1e8aa41009f658a2e166602a1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:56.534920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:56.537851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:56.564368 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515121d-2413-4194-948d-aca8d3b9a260 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:56.622163 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc72c8-7418-4174-a364-aa2483f7ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:56.623029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc72c8-7418-4174-a364-aa2483f7ddcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:56.623312 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc72c8-7418-4174-a364-aa2483f7ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:56.623587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc72c8-7418-4174-a364-aa2483f7ddcb admin admin] PATH_INFO: `/v3/projects/ed4f5fbca10d47d79aa0af5f30ec354f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:56.624741 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc72c8-7418-4174-a364-aa2483f7ddcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed4f5fbca10d47d79aa0af5f30ec354f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:56.626670 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc72c8-7418-4174-a364-aa2483f7ddcb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:56.728497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0fcc72c8-7418-4174-a364-aa2483f7ddcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4f5fbca10d47d79aa0af5f30ec354f', 'request_id': 'req-0fcc72c8-7418-4174-a364-aa2483f7ddcb'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:56.841920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0fcc72c8-7418-4174-a364-aa2483f7ddcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4f5fbca10d47d79aa0af5f30ec354f', 'request_id': 'req-0fcc72c8-7418-4174-a364-aa2483f7ddcb'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:56.847986 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0fcc72c8-7418-4174-a364-aa2483f7ddcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4f5fbca10d47d79aa0af5f30ec354f', 'request_id': 'req-0fcc72c8-7418-4174-a364-aa2483f7ddcb'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:56.859294 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0fcc72c8-7418-4174-a364-aa2483f7ddcb admin admin] The token cache is being invalidate because project ed4f5fbca10d47d79aa0af5f30ec354f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:39:56.859592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0fcc72c8-7418-4174-a364-aa2483f7ddcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:56.860239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0fcc72c8-7418-4174-a364-aa2483f7ddcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:56.861890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1123/2230] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:39:56 2021] DELETE /identity/v3/projects/ed4f5fbca10d47d79aa0af5f30ec354f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:56.867879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3648d-8d2d-4ae2-9ef3-27c5fe5f0207 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:56.868364 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3648d-8d2d-4ae2-9ef3-27c5fe5f0207 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:56.868481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3648d-8d2d-4ae2-9ef3-27c5fe5f0207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:56.887752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f8d3648d-8d2d-4ae2-9ef3-27c5fe5f0207 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:56.891396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f8d3648d-8d2d-4ae2-9ef3-27c5fe5f0207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:56.945211 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1108/2231] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:56.953237 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155a16-88b8-405a-a2b8-b65c27cfe406 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:56.953532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155a16-88b8-405a-a2b8-b65c27cfe406 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:56.953809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155a16-88b8-405a-a2b8-b65c27cfe406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:56.972730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-bc155a16-88b8-405a-a2b8-b65c27cfe406 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:56.974196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-bc155a16-88b8-405a-a2b8-b65c27cfe406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:56.982289 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1124/2232] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:39:56.986548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3648d-8d2d-4ae2-9ef3-27c5fe5f0207 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:56.996666 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3648d-8d2d-4ae2-9ef3-27c5fe5f0207 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:57.001288 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a7b67-95f8-493a-841a-bf09fcf3c069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:57.001974 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a7b67-95f8-493a-841a-bf09fcf3c069 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:57.002255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a7b67-95f8-493a-841a-bf09fcf3c069 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:57.002530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a7b67-95f8-493a-841a-bf09fcf3c069 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:57.003282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a7b67-95f8-493a-841a-bf09fcf3c069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:39:57.003657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a7b67-95f8-493a-841a-bf09fcf3c069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:57.005225 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a7b67-95f8-493a-841a-bf09fcf3c069 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:57.017313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1109/2233] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:39:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:39:57.032011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155a16-88b8-405a-a2b8-b65c27cfe406 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:57.041216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155a16-88b8-405a-a2b8-b65c27cfe406 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:57.045941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5061a-d28f-4223-b37c-e6a8d8cf34a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:57.046590 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5061a-d28f-4223-b37c-e6a8d8cf34a1 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:57.046869 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5061a-d28f-4223-b37c-e6a8d8cf34a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:57.047142 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5061a-d28f-4223-b37c-e6a8d8cf34a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:57.047860 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5061a-d28f-4223-b37c-e6a8d8cf34a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:57.049739 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5061a-d28f-4223-b37c-e6a8d8cf34a1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:57.157643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1125/2234] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:39:57 2021] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:39:57.161961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a7b67-95f8-493a-841a-bf09fcf3c069 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:57.171832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a7b67-95f8-493a-841a-bf09fcf3c069 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:57.227480 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824a63-4c51-4924-8554-50b1f031cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:57.228137 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824a63-4c51-4924-8554-50b1f031cd64 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:57.228419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824a63-4c51-4924-8554-50b1f031cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:57.228721 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824a63-4c51-4924-8554-50b1f031cd64 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:57.229407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58824a63-4c51-4924-8554-50b1f031cd64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:57.231338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58824a63-4c51-4924-8554-50b1f031cd64 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:57.343078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1110/2235] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:39:57 2021] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:39:57.344548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5061a-d28f-4223-b37c-e6a8d8cf34a1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:57.355503 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5061a-d28f-4223-b37c-e6a8d8cf34a1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:57.360586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716efc0-8b7f-4042-902b-3b3892b8ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:57.361441 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716efc0-8b7f-4042-902b-3b3892b8ca35 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:57.361781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716efc0-8b7f-4042-902b-3b3892b8ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:57.362229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716efc0-8b7f-4042-902b-3b3892b8ca35 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:57.362987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716efc0-8b7f-4042-902b-3b3892b8ca35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:57.364610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716efc0-8b7f-4042-902b-3b3892b8ca35 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:57.376267 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1126/2236] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:57 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:39:57.380350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824a63-4c51-4924-8554-50b1f031cd64 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:57.390784 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824a63-4c51-4924-8554-50b1f031cd64 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:57.395463 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27baf-7e1b-4d03-ad23-3d51f1809461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:57.396186 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27baf-7e1b-4d03-ad23-3d51f1809461 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:57.396547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27baf-7e1b-4d03-ad23-3d51f1809461 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:57.397371 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27baf-7e1b-4d03-ad23-3d51f1809461 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:57.398085 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27baf-7e1b-4d03-ad23-3d51f1809461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:57.399649 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27baf-7e1b-4d03-ad23-3d51f1809461 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:57.409312 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1111/2237] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:57 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:39:57.413758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716efc0-8b7f-4042-902b-3b3892b8ca35 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:57.423431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716efc0-8b7f-4042-902b-3b3892b8ca35 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:57.428181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9c103-94c9-4897-82bc-48a46081f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:57.429054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9c103-94c9-4897-82bc-48a46081f921 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:57.429331 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9c103-94c9-4897-82bc-48a46081f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:57.429604 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9c103-94c9-4897-82bc-48a46081f921 admin admin] PATH_INFO: `/v3/projects/5b93743771da46d092827a50f736218b/users/57717e377e0d4a4f8bf19f12dbef246e/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:57.446427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9c103-94c9-4897-82bc-48a46081f921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b93743771da46d092827a50f736218b, user_id=57717e377e0d4a4f8bf19f12dbef246e, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:57.448514 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9c103-94c9-4897-82bc-48a46081f921 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:57.511454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1127/2238] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:39:57 2021] PUT /identity/v3/projects/5b93743771da46d092827a50f736218b/users/57717e377e0d4a4f8bf19f12dbef246e/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:39:57.522302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdacc3-c9ed-46d0-8dd7-3caf8f2a69ae None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:57.522593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdacc3-c9ed-46d0-8dd7-3caf8f2a69ae None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:57.522867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdacc3-c9ed-46d0-8dd7-3caf8f2a69ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:57.548246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-01bdacc3-c9ed-46d0-8dd7-3caf8f2a69ae None None] MFA Rules not processed for user `57717e377e0d4a4f8bf19f12dbef246e`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:57.549476 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-01bdacc3-c9ed-46d0-8dd7-3caf8f2a69ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:57.611567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1112/2239] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:57 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:39:57.615655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9c103-94c9-4897-82bc-48a46081f921 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:57.677495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9c103-94c9-4897-82bc-48a46081f921 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:57.682580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321d5b9-228e-4351-b6ca-e2ea352fecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:57.683243 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321d5b9-228e-4351-b6ca-e2ea352fecec admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:57.683523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321d5b9-228e-4351-b6ca-e2ea352fecec admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:57.683796 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321d5b9-228e-4351-b6ca-e2ea352fecec admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:57.684642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321d5b9-228e-4351-b6ca-e2ea352fecec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:57.686594 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321d5b9-228e-4351-b6ca-e2ea352fecec admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:57.780512 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1128/2240] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:39:57 2021] POST /identity/v3/projects => generated 389 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:39:57.784331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdacc3-c9ed-46d0-8dd7-3caf8f2a69ae None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:57.795567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdacc3-c9ed-46d0-8dd7-3caf8f2a69ae None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:57.851371 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e9e6-a978-4a4f-ae74-e0b1397778a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:57.852051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e9e6-a978-4a4f-ae74-e0b1397778a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:57.852368 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e9e6-a978-4a4f-ae74-e0b1397778a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:57.852644 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e9e6-a978-4a4f-ae74-e0b1397778a8 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:57.853392 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442e9e6-a978-4a4f-ae74-e0b1397778a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:57.855414 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442e9e6-a978-4a4f-ae74-e0b1397778a8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:57.967490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1113/2241] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:39:57 2021] POST /identity/v3/users => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:39:57.973239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321d5b9-228e-4351-b6ca-e2ea352fecec admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:57.982502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321d5b9-228e-4351-b6ca-e2ea352fecec admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:57.987272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb69cc7-9767-4647-a0fd-35de21d2350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:57.987926 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb69cc7-9767-4647-a0fd-35de21d2350e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:57.988203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb69cc7-9767-4647-a0fd-35de21d2350e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:57.988474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb69cc7-9767-4647-a0fd-35de21d2350e admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:57.989190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb69cc7-9767-4647-a0fd-35de21d2350e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:57.991518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb69cc7-9767-4647-a0fd-35de21d2350e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:58.001751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1129/2242] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:39:58.005796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e9e6-a978-4a4f-ae74-e0b1397778a8 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:58.019375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e9e6-a978-4a4f-ae74-e0b1397778a8 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:58.024177 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283907ef-5141-427e-959d-b7f34f593a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:58.025072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283907ef-5141-427e-959d-b7f34f593a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:58.025355 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283907ef-5141-427e-959d-b7f34f593a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:58.025632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283907ef-5141-427e-959d-b7f34f593a20 admin admin] PATH_INFO: `/v3/projects/e0eeb016b1be43fd9f7c66a50530188f/users/1bd61b2075654e089f45f73c41c59dec/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:58.043389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283907ef-5141-427e-959d-b7f34f593a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0eeb016b1be43fd9f7c66a50530188f, user_id=1bd61b2075654e089f45f73c41c59dec, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:58.048706 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283907ef-5141-427e-959d-b7f34f593a20 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:58.131428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1114/2243] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:39:58 2021] PUT /identity/v3/projects/e0eeb016b1be43fd9f7c66a50530188f/users/1bd61b2075654e089f45f73c41c59dec/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:58.135301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb69cc7-9767-4647-a0fd-35de21d2350e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:58.145234 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb69cc7-9767-4647-a0fd-35de21d2350e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:58.204541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9e730-eb6d-44e4-b837-2226ac90d012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:58.205203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9e730-eb6d-44e4-b837-2226ac90d012 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:58.205484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9e730-eb6d-44e4-b837-2226ac90d012 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:58.205760 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9e730-eb6d-44e4-b837-2226ac90d012 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:58.206501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9e730-eb6d-44e4-b837-2226ac90d012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:58.208206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9e730-eb6d-44e4-b837-2226ac90d012 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:58.217955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1130/2244] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:39:58 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:39:58.221952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283907ef-5141-427e-959d-b7f34f593a20 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:58.232813 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283907ef-5141-427e-959d-b7f34f593a20 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:58.237583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5377a-bf74-4013-b5ee-0e6903ae84a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:58.238504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5377a-bf74-4013-b5ee-0e6903ae84a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:58.238784 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5377a-bf74-4013-b5ee-0e6903ae84a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:58.239057 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5377a-bf74-4013-b5ee-0e6903ae84a1 admin admin] PATH_INFO: `/v3/projects/e0eeb016b1be43fd9f7c66a50530188f/users/1bd61b2075654e089f45f73c41c59dec/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:58.241670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5377a-bf74-4013-b5ee-0e6903ae84a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0eeb016b1be43fd9f7c66a50530188f, user_id=1bd61b2075654e089f45f73c41c59dec, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:58.244516 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5377a-bf74-4013-b5ee-0e6903ae84a1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:58.255214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1115/2245] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:39:58 2021] PUT /identity/v3/projects/e0eeb016b1be43fd9f7c66a50530188f/users/1bd61b2075654e089f45f73c41c59dec/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:39:58.266413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68d86-2cd3-41e2-9a7b-0097040a9d8b None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:58.266706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68d86-2cd3-41e2-9a7b-0097040a9d8b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:58.266988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68d86-2cd3-41e2-9a7b-0097040a9d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:58.293739 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d2f68d86-2cd3-41e2-9a7b-0097040a9d8b None None] MFA Rules not processed for user `1bd61b2075654e089f45f73c41c59dec`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:58.294973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d2f68d86-2cd3-41e2-9a7b-0097040a9d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:58.369226 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1131/2246] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:58 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:58.379358 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5377a-bf74-4013-b5ee-0e6903ae84a1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:58.381760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-45c5377a-bf74-4013-b5ee-0e6903ae84a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:58.443460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5377a-bf74-4013-b5ee-0e6903ae84a1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:58.447921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa42a2c-baf8-4023-a7b4-8f3a4cec4ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:58.448562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42a2c-baf8-4023-a7b4-8f3a4cec4ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:58.449585 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42a2c-baf8-4023-a7b4-8f3a4cec4ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:58.449585 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42a2c-baf8-4023-a7b4-8f3a4cec4ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:58.458587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa42a2c-baf8-4023-a7b4-8f3a4cec4ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:58.460449 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa42a2c-baf8-4023-a7b4-8f3a4cec4ac1 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:58.469758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1116/2247] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:39:58 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:39:58.608709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f68d86-2cd3-41e2-9a7b-0097040a9d8b None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:58.677497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f68d86-2cd3-41e2-9a7b-0097040a9d8b None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:58.683097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:58.683975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:58.684253 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:58.684521 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] PATH_INFO: `/v3/users/57717e377e0d4a4f8bf19f12dbef246e` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:58.685750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57717e377e0d4a4f8bf19f12dbef246e)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:58.687705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:58.881888 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57717e377e0d4a4f8bf19f12dbef246e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:58.882576 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57717e377e0d4a4f8bf19f12dbef246e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:58.883178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57717e377e0d4a4f8bf19f12dbef246e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:58.962083 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57717e377e0d4a4f8bf19f12dbef246e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:58.975568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57717e377e0d4a4f8bf19f12dbef246e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:39:58.988180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1132/2248] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:39:58 2021] DELETE /identity/v3/users/57717e377e0d4a4f8bf19f12dbef246e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:39:58.993407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc491d-73db-4b1f-8c78-7d366dfee28a None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:58.993922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc491d-73db-4b1f-8c78-7d366dfee28a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:58.994055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc491d-73db-4b1f-8c78-7d366dfee28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:59.011650 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-47fc491d-73db-4b1f-8c78-7d366dfee28a None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:39:59.012960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-47fc491d-73db-4b1f-8c78-7d366dfee28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:59.069497 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1117/2249] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:39:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:39:59.079617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:39:59.084431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:39:59.143246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4694d-bde9-4b45-bf9b-b62c1115024d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:39:59.146931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526736a-96c0-4b25-8e3b-e7cfec8befb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:39:59.147569 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526736a-96c0-4b25-8e3b-e7cfec8befb0 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:39:59.147846 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526736a-96c0-4b25-8e3b-e7cfec8befb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:39:59.148121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526736a-96c0-4b25-8e3b-e7cfec8befb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:39:59.156889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526736a-96c0-4b25-8e3b-e7cfec8befb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:39:59.158349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526736a-96c0-4b25-8e3b-e7cfec8befb0 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:39:59.168590 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1133/2250] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:39:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:40:00.041901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc491d-73db-4b1f-8c78-7d366dfee28a None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:00.047673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-47fc491d-73db-4b1f-8c78-7d366dfee28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:00.056740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc491d-73db-4b1f-8c78-7d366dfee28a None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:00.061410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:00.062308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:00.062586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:00.062859 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] PATH_INFO: `/v3/projects/5b93743771da46d092827a50f736218b` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:00.064045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b93743771da46d092827a50f736218b)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:00.065969 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:00.216220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b93743771da46d092827a50f736218b', 'request_id': 'req-ed5e130e-b0fc-4f00-b06e-add1e545abd2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:00.302158 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b93743771da46d092827a50f736218b', 'request_id': 'req-ed5e130e-b0fc-4f00-b06e-add1e545abd2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:00.309100 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b93743771da46d092827a50f736218b', 'request_id': 'req-ed5e130e-b0fc-4f00-b06e-add1e545abd2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:00.320572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] The token cache is being invalidate because project 5b93743771da46d092827a50f736218b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:40:00.320849 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:00.321537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:00.323082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1118/2251] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:40:00 2021] DELETE /identity/v3/projects/5b93743771da46d092827a50f736218b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:00.327588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526736a-96c0-4b25-8e3b-e7cfec8befb0 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:00.337369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526736a-96c0-4b25-8e3b-e7cfec8befb0 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:00.392224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bbb8d-2d98-4b9f-815e-f9b593dd7df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:00.393102 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bbb8d-2d98-4b9f-815e-f9b593dd7df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:00.393388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bbb8d-2d98-4b9f-815e-f9b593dd7df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:00.393722 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bbb8d-2d98-4b9f-815e-f9b593dd7df3 admin admin] PATH_INFO: `/v3/users/1bd61b2075654e089f45f73c41c59dec` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:00.394940 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bbb8d-2d98-4b9f-815e-f9b593dd7df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd61b2075654e089f45f73c41c59dec)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:00.396919 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bbb8d-2d98-4b9f-815e-f9b593dd7df3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:00.569326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-6e5bbb8d-2d98-4b9f-815e-f9b593dd7df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd61b2075654e089f45f73c41c59dec'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:00.570044 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-6e5bbb8d-2d98-4b9f-815e-f9b593dd7df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd61b2075654e089f45f73c41c59dec'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:00.570635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-6e5bbb8d-2d98-4b9f-815e-f9b593dd7df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd61b2075654e089f45f73c41c59dec'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:00.624302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-6e5bbb8d-2d98-4b9f-815e-f9b593dd7df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd61b2075654e089f45f73c41c59dec'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:00.637296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-6e5bbb8d-2d98-4b9f-815e-f9b593dd7df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd61b2075654e089f45f73c41c59dec'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:00.649539 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1134/2252] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:40:00 2021] DELETE /identity/v3/users/1bd61b2075654e089f45f73c41c59dec => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:01.071932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:01.074228 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:01.091294 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e130e-b0fc-4f00-b06e-add1e545abd2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:01.152507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf9b08-6f5c-439b-a096-4e9dba64d451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:01.153358 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf9b08-6f5c-439b-a096-4e9dba64d451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:01.153638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf9b08-6f5c-439b-a096-4e9dba64d451 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:01.153940 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf9b08-6f5c-439b-a096-4e9dba64d451 admin admin] PATH_INFO: `/v3/projects/e0eeb016b1be43fd9f7c66a50530188f` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:01.155175 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf9b08-6f5c-439b-a096-4e9dba64d451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0eeb016b1be43fd9f7c66a50530188f)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:01.157052 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf9b08-6f5c-439b-a096-4e9dba64d451 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:01.288021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6daf9b08-6f5c-439b-a096-4e9dba64d451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0eeb016b1be43fd9f7c66a50530188f', 'request_id': 'req-6daf9b08-6f5c-439b-a096-4e9dba64d451'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:01.407208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6daf9b08-6f5c-439b-a096-4e9dba64d451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0eeb016b1be43fd9f7c66a50530188f', 'request_id': 'req-6daf9b08-6f5c-439b-a096-4e9dba64d451'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:01.413163 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6daf9b08-6f5c-439b-a096-4e9dba64d451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0eeb016b1be43fd9f7c66a50530188f', 'request_id': 'req-6daf9b08-6f5c-439b-a096-4e9dba64d451'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:01.423880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6daf9b08-6f5c-439b-a096-4e9dba64d451 admin admin] The token cache is being invalidate because project e0eeb016b1be43fd9f7c66a50530188f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:40:01.424162 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6daf9b08-6f5c-439b-a096-4e9dba64d451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:01.424766 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6daf9b08-6f5c-439b-a096-4e9dba64d451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:01.426308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1119/2253] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:40:01 2021] DELETE /identity/v3/projects/e0eeb016b1be43fd9f7c66a50530188f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:01.432180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991be4c-2136-48e7-9736-81e01b998276 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:01.432637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991be4c-2136-48e7-9736-81e01b998276 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:01.432729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991be4c-2136-48e7-9736-81e01b998276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:01.451476 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-2991be4c-2136-48e7-9736-81e01b998276 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:01.452668 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2991be4c-2136-48e7-9736-81e01b998276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:01.509736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1135/2254] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:01.517835 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf222b-6470-403f-8791-7c3780ce169c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:01.518157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf222b-6470-403f-8791-7c3780ce169c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:01.518640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf222b-6470-403f-8791-7c3780ce169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:01.538894 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-efbf222b-6470-403f-8791-7c3780ce169c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:01.540232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-efbf222b-6470-403f-8791-7c3780ce169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:01.559993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1120/2255] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:01.564122 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991be4c-2136-48e7-9736-81e01b998276 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:01.575018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991be4c-2136-48e7-9736-81e01b998276 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:01.579841 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d27a1-d37f-469f-9a96-a74146170992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:01.580501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d27a1-d37f-469f-9a96-a74146170992 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:01.580787 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d27a1-d37f-469f-9a96-a74146170992 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:01.581070 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d27a1-d37f-469f-9a96-a74146170992 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:01.581798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d27a1-d37f-469f-9a96-a74146170992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:40:01.582141 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d27a1-d37f-469f-9a96-a74146170992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:01.583788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d27a1-d37f-469f-9a96-a74146170992 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:01.596394 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1136/2256] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:40:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:40:01.601183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf222b-6470-403f-8791-7c3780ce169c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:01.611051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf222b-6470-403f-8791-7c3780ce169c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:01.616953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f69779-6aea-4fa2-9e90-8df5d35ae47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:01.617662 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69779-6aea-4fa2-9e90-8df5d35ae47c admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:01.617976 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69779-6aea-4fa2-9e90-8df5d35ae47c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:01.618259 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69779-6aea-4fa2-9e90-8df5d35ae47c admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:01.618972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f69779-6aea-4fa2-9e90-8df5d35ae47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:01.621027 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f69779-6aea-4fa2-9e90-8df5d35ae47c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:01.715843 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1121/2257] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:40:01 2021] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:40:01.717107 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d27a1-d37f-469f-9a96-a74146170992 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:01.728023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d27a1-d37f-469f-9a96-a74146170992 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:01.796836 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf27c4-ba7c-4c37-a83a-d8f10dd3458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:01.797641 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf27c4-ba7c-4c37-a83a-d8f10dd3458f admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:01.797978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf27c4-ba7c-4c37-a83a-d8f10dd3458f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:01.798252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf27c4-ba7c-4c37-a83a-d8f10dd3458f admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:01.798933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf27c4-ba7c-4c37-a83a-d8f10dd3458f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:01.800865 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf27c4-ba7c-4c37-a83a-d8f10dd3458f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:01.880273 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1137/2258] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:40:01 2021] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:40:01.883881 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f69779-6aea-4fa2-9e90-8df5d35ae47c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:01.894343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f69779-6aea-4fa2-9e90-8df5d35ae47c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:01.899780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364997fc-e744-4da8-9a19-28789f741b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:01.900954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364997fc-e744-4da8-9a19-28789f741b40 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:01.900954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364997fc-e744-4da8-9a19-28789f741b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:01.901152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364997fc-e744-4da8-9a19-28789f741b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:01.901699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364997fc-e744-4da8-9a19-28789f741b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:01.903314 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364997fc-e744-4da8-9a19-28789f741b40 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:01.913535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1122/2259] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:01.917670 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf27c4-ba7c-4c37-a83a-d8f10dd3458f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:01.928612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf27c4-ba7c-4c37-a83a-d8f10dd3458f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:01.933655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849a364-a19a-468c-99e0-640d78e201f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:01.934441 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849a364-a19a-468c-99e0-640d78e201f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:01.934750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849a364-a19a-468c-99e0-640d78e201f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:01.935176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849a364-a19a-468c-99e0-640d78e201f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:01.935975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849a364-a19a-468c-99e0-640d78e201f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:01.937558 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849a364-a19a-468c-99e0-640d78e201f0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:01.949190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1138/2260] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:01 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:01.953667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364997fc-e744-4da8-9a19-28789f741b40 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:01.964208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364997fc-e744-4da8-9a19-28789f741b40 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:01.968796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0193f1-bb22-42f8-85cc-8ccc88e7c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:01.969666 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0193f1-bb22-42f8-85cc-8ccc88e7c2e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:01.969984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0193f1-bb22-42f8-85cc-8ccc88e7c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:01.970261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0193f1-bb22-42f8-85cc-8ccc88e7c2e2 admin admin] PATH_INFO: `/v3/projects/a992cab5818b42bbb6be003bad295866/users/c02a0ec49a1449faa5904a5395c795b2/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:01.985082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0193f1-bb22-42f8-85cc-8ccc88e7c2e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a992cab5818b42bbb6be003bad295866, user_id=c02a0ec49a1449faa5904a5395c795b2, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:01.987755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0193f1-bb22-42f8-85cc-8ccc88e7c2e2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:02.051085 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1123/2261] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:01 2021] PUT /identity/v3/projects/a992cab5818b42bbb6be003bad295866/users/c02a0ec49a1449faa5904a5395c795b2/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:02.063042 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429228e-0aa0-4129-a311-c0741e040b60 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:02.063334 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429228e-0aa0-4129-a311-c0741e040b60 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:02.063616 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429228e-0aa0-4129-a311-c0741e040b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:02.089565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-1429228e-0aa0-4129-a311-c0741e040b60 None None] MFA Rules not processed for user `c02a0ec49a1449faa5904a5395c795b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:02.090906 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1429228e-0aa0-4129-a311-c0741e040b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:02.153454 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1139/2262] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:02 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:02.158114 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0193f1-bb22-42f8-85cc-8ccc88e7c2e2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:02.218449 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0193f1-bb22-42f8-85cc-8ccc88e7c2e2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:02.223210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594d45-014e-4606-a881-4ef0b79028e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:02.223873 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594d45-014e-4606-a881-4ef0b79028e8 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:02.224410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594d45-014e-4606-a881-4ef0b79028e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:02.224771 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594d45-014e-4606-a881-4ef0b79028e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:02.225481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594d45-014e-4606-a881-4ef0b79028e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:02.227403 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594d45-014e-4606-a881-4ef0b79028e8 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:02.306147 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1124/2263] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:40:02 2021] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:40:02.310177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429228e-0aa0-4129-a311-c0741e040b60 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:02.321811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429228e-0aa0-4129-a311-c0741e040b60 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:02.376077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d4161-0e90-4f06-aee9-98d58d801a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:02.376736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d4161-0e90-4f06-aee9-98d58d801a0a admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:02.377020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d4161-0e90-4f06-aee9-98d58d801a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:02.377298 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d4161-0e90-4f06-aee9-98d58d801a0a admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:02.378013 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d4161-0e90-4f06-aee9-98d58d801a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:02.379928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d4161-0e90-4f06-aee9-98d58d801a0a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:02.467415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1140/2264] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:40:02 2021] POST /identity/v3/users => generated 300 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:40:02.471561 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594d45-014e-4606-a881-4ef0b79028e8 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:02.482031 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594d45-014e-4606-a881-4ef0b79028e8 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:02.486671 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16fc40-94a0-4673-b23d-514d95b5b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:02.487315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16fc40-94a0-4673-b23d-514d95b5b861 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:02.487592 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16fc40-94a0-4673-b23d-514d95b5b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:02.487867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16fc40-94a0-4673-b23d-514d95b5b861 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:02.488582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16fc40-94a0-4673-b23d-514d95b5b861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:02.490665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16fc40-94a0-4673-b23d-514d95b5b861 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:02.500702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1125/2265] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:02.504759 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d4161-0e90-4f06-aee9-98d58d801a0a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:02.515302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d4161-0e90-4f06-aee9-98d58d801a0a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:02.520077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566854ce-42ea-4361-b43d-304489710bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:02.520939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566854ce-42ea-4361-b43d-304489710bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:02.521229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566854ce-42ea-4361-b43d-304489710bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:02.522094 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566854ce-42ea-4361-b43d-304489710bbf admin admin] PATH_INFO: `/v3/projects/8fdcf4d19add472ca549f8220103da0f/users/bac77dcad4d34dd79d048d7ef850d562/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:02.536053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566854ce-42ea-4361-b43d-304489710bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdcf4d19add472ca549f8220103da0f, user_id=bac77dcad4d34dd79d048d7ef850d562, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:02.539325 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566854ce-42ea-4361-b43d-304489710bbf admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:02.606799 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1141/2266] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:02 2021] PUT /identity/v3/projects/8fdcf4d19add472ca549f8220103da0f/users/bac77dcad4d34dd79d048d7ef850d562/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:02.610667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16fc40-94a0-4673-b23d-514d95b5b861 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:02.620615 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16fc40-94a0-4673-b23d-514d95b5b861 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:02.674071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b53ff-f4db-4e2d-a162-50fdd2fe7264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:02.674727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b53ff-f4db-4e2d-a162-50fdd2fe7264 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:02.675007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b53ff-f4db-4e2d-a162-50fdd2fe7264 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:02.675281 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b53ff-f4db-4e2d-a162-50fdd2fe7264 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:02.675996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b53ff-f4db-4e2d-a162-50fdd2fe7264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:02.677594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b53ff-f4db-4e2d-a162-50fdd2fe7264 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:02.687056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1126/2267] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:40:02.690898 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566854ce-42ea-4361-b43d-304489710bbf admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:02.701510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566854ce-42ea-4361-b43d-304489710bbf admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:02.706182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707f27b-a6b8-439b-bfcd-1e969690891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:02.707049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f27b-a6b8-439b-bfcd-1e969690891d admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:02.707330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f27b-a6b8-439b-bfcd-1e969690891d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:02.707605 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f27b-a6b8-439b-bfcd-1e969690891d admin admin] PATH_INFO: `/v3/projects/8fdcf4d19add472ca549f8220103da0f/users/bac77dcad4d34dd79d048d7ef850d562/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:02.710237 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707f27b-a6b8-439b-bfcd-1e969690891d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdcf4d19add472ca549f8220103da0f, user_id=bac77dcad4d34dd79d048d7ef850d562, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:02.712849 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707f27b-a6b8-439b-bfcd-1e969690891d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:02.722982 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1142/2268] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:02 2021] PUT /identity/v3/projects/8fdcf4d19add472ca549f8220103da0f/users/bac77dcad4d34dd79d048d7ef850d562/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:02.732928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705dd5e-76b9-48fc-a656-f6d446689207 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:02.733214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705dd5e-76b9-48fc-a656-f6d446689207 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:02.733489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705dd5e-76b9-48fc-a656-f6d446689207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:02.760397 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-8705dd5e-76b9-48fc-a656-f6d446689207 None None] MFA Rules not processed for user `bac77dcad4d34dd79d048d7ef850d562`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:02.761616 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8705dd5e-76b9-48fc-a656-f6d446689207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:02.826961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1127/2269] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:02 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:02.837411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707f27b-a6b8-439b-bfcd-1e969690891d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:02.839098 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f707f27b-a6b8-439b-bfcd-1e969690891d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:02.894910 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707f27b-a6b8-439b-bfcd-1e969690891d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:02.899235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253a063-f01b-46af-8a5a-d60955c8d717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:02.899875 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253a063-f01b-46af-8a5a-d60955c8d717 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:02.900157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253a063-f01b-46af-8a5a-d60955c8d717 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:02.900434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253a063-f01b-46af-8a5a-d60955c8d717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:02.909439 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253a063-f01b-46af-8a5a-d60955c8d717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:02.910898 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253a063-f01b-46af-8a5a-d60955c8d717 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:02.920687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1143/2270] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:02 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:03.973788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705dd5e-76b9-48fc-a656-f6d446689207 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:04.032954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705dd5e-76b9-48fc-a656-f6d446689207 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:04.038210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:04.039071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:04.039351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:04.039625 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] PATH_INFO: `/v3/users/c02a0ec49a1449faa5904a5395c795b2` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:04.040796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02a0ec49a1449faa5904a5395c795b2)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:04.042731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:04.229953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02a0ec49a1449faa5904a5395c795b2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:04.230538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02a0ec49a1449faa5904a5395c795b2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:04.237229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02a0ec49a1449faa5904a5395c795b2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:04.330818 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02a0ec49a1449faa5904a5395c795b2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:04.342508 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02a0ec49a1449faa5904a5395c795b2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:04.348309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1128/2271] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:40:03 2021] DELETE /identity/v3/users/c02a0ec49a1449faa5904a5395c795b2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:04.353549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5c7d2-2819-4f9c-bd32-12f6f37a2e2f None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:04.354055 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5c7d2-2819-4f9c-bd32-12f6f37a2e2f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:04.354158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5c7d2-2819-4f9c-bd32-12f6f37a2e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:04.372300 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c2b5c7d2-2819-4f9c-bd32-12f6f37a2e2f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:04.379288 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c2b5c7d2-2819-4f9c-bd32-12f6f37a2e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:04.435737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1144/2272] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:04.446167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:04.447557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:04.507626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8ddc5-2899-4d74-948c-2d7b5cf7e30b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:04.511220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f1f40-8a8c-49f4-ba50-ed511b4657ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:04.511857 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f1f40-8a8c-49f4-ba50-ed511b4657ca service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:04.512132 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f1f40-8a8c-49f4-ba50-ed511b4657ca service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:04.512402 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f1f40-8a8c-49f4-ba50-ed511b4657ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:04.521036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f1f40-8a8c-49f4-ba50-ed511b4657ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:04.522478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f1f40-8a8c-49f4-ba50-ed511b4657ca service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:04.531539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1129/2273] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:04.995359 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5c7d2-2819-4f9c-bd32-12f6f37a2e2f None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:04.996929 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c2b5c7d2-2819-4f9c-bd32-12f6f37a2e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:05.011461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5c7d2-2819-4f9c-bd32-12f6f37a2e2f None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:05.016366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:05.017411 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:05.017699 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:05.018001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] PATH_INFO: `/v3/projects/a992cab5818b42bbb6be003bad295866` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:05.019200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a992cab5818b42bbb6be003bad295866)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:05.021150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:05.129804 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a992cab5818b42bbb6be003bad295866', 'request_id': 'req-d8f81835-11d7-43ce-8536-513cd04261b5'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:05.218790 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a992cab5818b42bbb6be003bad295866', 'request_id': 'req-d8f81835-11d7-43ce-8536-513cd04261b5'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:05.224480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a992cab5818b42bbb6be003bad295866', 'request_id': 'req-d8f81835-11d7-43ce-8536-513cd04261b5'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:05.235584 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] The token cache is being invalidate because project a992cab5818b42bbb6be003bad295866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:40:05.235872 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:05.236487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:05.238035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1145/2274] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:40:04 2021] DELETE /identity/v3/projects/a992cab5818b42bbb6be003bad295866 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:05.242293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f1f40-8a8c-49f4-ba50-ed511b4657ca service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:05.251916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f1f40-8a8c-49f4-ba50-ed511b4657ca service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:05.304995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d1135-3382-436f-8592-20382f79c2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:05.305851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d1135-3382-436f-8592-20382f79c2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:05.306156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d1135-3382-436f-8592-20382f79c2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:05.306425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d1135-3382-436f-8592-20382f79c2d5 admin admin] PATH_INFO: `/v3/users/bac77dcad4d34dd79d048d7ef850d562` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:05.307597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d1135-3382-436f-8592-20382f79c2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac77dcad4d34dd79d048d7ef850d562)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:05.309482 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d1135-3382-436f-8592-20382f79c2d5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:05.601084 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-477d1135-3382-436f-8592-20382f79c2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac77dcad4d34dd79d048d7ef850d562'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:05.601727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-477d1135-3382-436f-8592-20382f79c2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac77dcad4d34dd79d048d7ef850d562'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:05.608214 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-477d1135-3382-436f-8592-20382f79c2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac77dcad4d34dd79d048d7ef850d562'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:05.681195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-477d1135-3382-436f-8592-20382f79c2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac77dcad4d34dd79d048d7ef850d562'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:05.693221 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-477d1135-3382-436f-8592-20382f79c2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac77dcad4d34dd79d048d7ef850d562'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:05.706424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1130/2275] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:40:05 2021] DELETE /identity/v3/users/bac77dcad4d34dd79d048d7ef850d562 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:06.154163 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:06.157759 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:06.169660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81835-11d7-43ce-8536-513cd04261b5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:06.229753 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefeb698-613a-479d-9dc0-4ccb1628e81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:06.230645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeb698-613a-479d-9dc0-4ccb1628e81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:06.230921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeb698-613a-479d-9dc0-4ccb1628e81c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:06.231194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeb698-613a-479d-9dc0-4ccb1628e81c admin admin] PATH_INFO: `/v3/projects/8fdcf4d19add472ca549f8220103da0f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:06.232416 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefeb698-613a-479d-9dc0-4ccb1628e81c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fdcf4d19add472ca549f8220103da0f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:06.234341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefeb698-613a-479d-9dc0-4ccb1628e81c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:06.329498 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fefeb698-613a-479d-9dc0-4ccb1628e81c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fdcf4d19add472ca549f8220103da0f', 'request_id': 'req-fefeb698-613a-479d-9dc0-4ccb1628e81c'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:06.393444 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fefeb698-613a-479d-9dc0-4ccb1628e81c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fdcf4d19add472ca549f8220103da0f', 'request_id': 'req-fefeb698-613a-479d-9dc0-4ccb1628e81c'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:06.399177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fefeb698-613a-479d-9dc0-4ccb1628e81c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fdcf4d19add472ca549f8220103da0f', 'request_id': 'req-fefeb698-613a-479d-9dc0-4ccb1628e81c'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:06.409834 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fefeb698-613a-479d-9dc0-4ccb1628e81c admin admin] The token cache is being invalidate because project 8fdcf4d19add472ca549f8220103da0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:40:06.410152 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fefeb698-613a-479d-9dc0-4ccb1628e81c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:06.410771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-fefeb698-613a-479d-9dc0-4ccb1628e81c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:06.412835 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1146/2276] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:40:06 2021] DELETE /identity/v3/projects/8fdcf4d19add472ca549f8220103da0f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:06.418990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4589f-77f8-47a5-8022-f235d7cad446 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:06.419455 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4589f-77f8-47a5-8022-f235d7cad446 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:06.419563 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4589f-77f8-47a5-8022-f235d7cad446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:06.438026 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-bcf4589f-77f8-47a5-8022-f235d7cad446 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:06.439213 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-bcf4589f-77f8-47a5-8022-f235d7cad446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:06.504026 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1131/2277] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:06.507720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db58cfd-7e09-4be7-a394-7cbdb2731595 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:06.508015 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db58cfd-7e09-4be7-a394-7cbdb2731595 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:06.508299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db58cfd-7e09-4be7-a394-7cbdb2731595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:06.526643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-4db58cfd-7e09-4be7-a394-7cbdb2731595 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:06.527825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4db58cfd-7e09-4be7-a394-7cbdb2731595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:06.535732 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1147/2278] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:06.540322 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4589f-77f8-47a5-8022-f235d7cad446 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:06.549756 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4589f-77f8-47a5-8022-f235d7cad446 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:06.555543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11975768-dfe4-4c05-9aac-c5b4f6e9b913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:06.556213 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11975768-dfe4-4c05-9aac-c5b4f6e9b913 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:06.556484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11975768-dfe4-4c05-9aac-c5b4f6e9b913 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:06.556758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11975768-dfe4-4c05-9aac-c5b4f6e9b913 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:06.557476 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11975768-dfe4-4c05-9aac-c5b4f6e9b913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:40:06.557780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11975768-dfe4-4c05-9aac-c5b4f6e9b913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:06.559380 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11975768-dfe4-4c05-9aac-c5b4f6e9b913 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:06.570825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1132/2279] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:40:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:40:06.575188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db58cfd-7e09-4be7-a394-7cbdb2731595 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:06.584206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db58cfd-7e09-4be7-a394-7cbdb2731595 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:06.588903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765051a3-efd5-48b4-b249-7acfeaff1328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:06.589539 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765051a3-efd5-48b4-b249-7acfeaff1328 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:06.589820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765051a3-efd5-48b4-b249-7acfeaff1328 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:06.590124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765051a3-efd5-48b4-b249-7acfeaff1328 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:06.590805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765051a3-efd5-48b4-b249-7acfeaff1328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:06.592683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765051a3-efd5-48b4-b249-7acfeaff1328 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:06.688793 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1148/2280] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:40:06 2021] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:40:06.692872 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11975768-dfe4-4c05-9aac-c5b4f6e9b913 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:06.703043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11975768-dfe4-4c05-9aac-c5b4f6e9b913 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:06.756529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700665c5-adf7-47f3-86fe-3ebcbecb784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:06.757183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700665c5-adf7-47f3-86fe-3ebcbecb784c admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:06.757490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700665c5-adf7-47f3-86fe-3ebcbecb784c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:06.757763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700665c5-adf7-47f3-86fe-3ebcbecb784c admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:06.758477 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700665c5-adf7-47f3-86fe-3ebcbecb784c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:06.760362 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700665c5-adf7-47f3-86fe-3ebcbecb784c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:06.858755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1133/2281] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:40:06 2021] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:40:06.862722 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765051a3-efd5-48b4-b249-7acfeaff1328 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:06.873325 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765051a3-efd5-48b4-b249-7acfeaff1328 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:06.878515 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793abd33-95b2-4cef-8ebf-fe26c62051b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:06.879275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793abd33-95b2-4cef-8ebf-fe26c62051b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:06.879622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793abd33-95b2-4cef-8ebf-fe26c62051b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:06.879962 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793abd33-95b2-4cef-8ebf-fe26c62051b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:06.880748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793abd33-95b2-4cef-8ebf-fe26c62051b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:06.882459 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793abd33-95b2-4cef-8ebf-fe26c62051b8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:06.893694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1149/2282] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:40:06.897799 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700665c5-adf7-47f3-86fe-3ebcbecb784c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:06.907610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700665c5-adf7-47f3-86fe-3ebcbecb784c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:06.912807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c93e0-b7ec-4565-865c-f855893dc6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:06.913467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c93e0-b7ec-4565-865c-f855893dc6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:06.913743 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c93e0-b7ec-4565-865c-f855893dc6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:06.914053 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c93e0-b7ec-4565-865c-f855893dc6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:06.914765 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c93e0-b7ec-4565-865c-f855893dc6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:06.916323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c93e0-b7ec-4565-865c-f855893dc6d6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:06.925752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1134/2283] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:06.929725 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793abd33-95b2-4cef-8ebf-fe26c62051b8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:06.939517 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793abd33-95b2-4cef-8ebf-fe26c62051b8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:06.944188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8cf48-e3e2-4b11-9455-19e6b87ce517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:06.945058 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8cf48-e3e2-4b11-9455-19e6b87ce517 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:06.945337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8cf48-e3e2-4b11-9455-19e6b87ce517 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:06.945611 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8cf48-e3e2-4b11-9455-19e6b87ce517 admin admin] PATH_INFO: `/v3/projects/2f8e896b4e5640b99aa94646d53b8e46/users/3712b9fa0c984323a58afa76e5fc3f6f/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:06.960159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8cf48-e3e2-4b11-9455-19e6b87ce517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8e896b4e5640b99aa94646d53b8e46, user_id=3712b9fa0c984323a58afa76e5fc3f6f, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:06.962810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8cf48-e3e2-4b11-9455-19e6b87ce517 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:07.068839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1150/2284] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:06 2021] PUT /identity/v3/projects/2f8e896b4e5640b99aa94646d53b8e46/users/3712b9fa0c984323a58afa76e5fc3f6f/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:07.079640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03212c3-e32b-49da-8419-54a236579146 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:07.080538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03212c3-e32b-49da-8419-54a236579146 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:07.080538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03212c3-e32b-49da-8419-54a236579146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:07.106630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e03212c3-e32b-49da-8419-54a236579146 None None] MFA Rules not processed for user `3712b9fa0c984323a58afa76e5fc3f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:07.107821 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e03212c3-e32b-49da-8419-54a236579146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:07.169721 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1135/2285] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:07 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:07.174158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8cf48-e3e2-4b11-9455-19e6b87ce517 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:07.236641 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8cf48-e3e2-4b11-9455-19e6b87ce517 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:07.241242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b462-8aff-48fb-b013-3fd79d360db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:07.241917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b462-8aff-48fb-b013-3fd79d360db2 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:07.242203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b462-8aff-48fb-b013-3fd79d360db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:07.242479 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b462-8aff-48fb-b013-3fd79d360db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:07.243164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045b462-8aff-48fb-b013-3fd79d360db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:07.245056 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045b462-8aff-48fb-b013-3fd79d360db2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:07.322909 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1151/2286] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:40:07 2021] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:40:07.327138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03212c3-e32b-49da-8419-54a236579146 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:07.338222 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03212c3-e32b-49da-8419-54a236579146 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:07.392226 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b4b8a-8ddb-4dc5-bb95-aafc140f4c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:07.392883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b4b8a-8ddb-4dc5-bb95-aafc140f4c7f admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:07.393222 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b4b8a-8ddb-4dc5-bb95-aafc140f4c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:07.393491 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b4b8a-8ddb-4dc5-bb95-aafc140f4c7f admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:07.394184 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b4b8a-8ddb-4dc5-bb95-aafc140f4c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:07.396071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b4b8a-8ddb-4dc5-bb95-aafc140f4c7f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:07.481467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1136/2287] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:40:07 2021] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:40:07.485465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b462-8aff-48fb-b013-3fd79d360db2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:07.503097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b462-8aff-48fb-b013-3fd79d360db2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:07.503097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9a133-34a2-40b6-93fe-fac5fe000151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:07.503097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9a133-34a2-40b6-93fe-fac5fe000151 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:07.503097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9a133-34a2-40b6-93fe-fac5fe000151 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:07.503656 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9a133-34a2-40b6-93fe-fac5fe000151 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:07.503656 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9a133-34a2-40b6-93fe-fac5fe000151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:07.504934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9a133-34a2-40b6-93fe-fac5fe000151 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:07.515939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1152/2288] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:40:07.520087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b4b8a-8ddb-4dc5-bb95-aafc140f4c7f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:07.530105 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b4b8a-8ddb-4dc5-bb95-aafc140f4c7f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:07.534715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23fcf6-14ee-4fb8-baf7-d746a71c9245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:07.535579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23fcf6-14ee-4fb8-baf7-d746a71c9245 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:07.535856 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23fcf6-14ee-4fb8-baf7-d746a71c9245 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:07.536129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23fcf6-14ee-4fb8-baf7-d746a71c9245 admin admin] PATH_INFO: `/v3/projects/3d63c2e381c14f8eaf6ca10f0e5f0612/users/0f09c8e3e1534020a6bb405c72dfcefd/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:07.550019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23fcf6-14ee-4fb8-baf7-d746a71c9245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d63c2e381c14f8eaf6ca10f0e5f0612, user_id=0f09c8e3e1534020a6bb405c72dfcefd, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:07.552624 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23fcf6-14ee-4fb8-baf7-d746a71c9245 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:07.647040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1137/2289] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:07 2021] PUT /identity/v3/projects/3d63c2e381c14f8eaf6ca10f0e5f0612/users/0f09c8e3e1534020a6bb405c72dfcefd/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:07.655349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9a133-34a2-40b6-93fe-fac5fe000151 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:07.665494 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9a133-34a2-40b6-93fe-fac5fe000151 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:07.718762 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351ef5c-46df-43a5-9d81-49e357f8e48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:07.719418 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351ef5c-46df-43a5-9d81-49e357f8e48b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:07.719700 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351ef5c-46df-43a5-9d81-49e357f8e48b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:07.719973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351ef5c-46df-43a5-9d81-49e357f8e48b admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:07.720679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351ef5c-46df-43a5-9d81-49e357f8e48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:07.722289 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351ef5c-46df-43a5-9d81-49e357f8e48b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:07.736132 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1153/2290] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:07 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:07.740629 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23fcf6-14ee-4fb8-baf7-d746a71c9245 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:07.750617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23fcf6-14ee-4fb8-baf7-d746a71c9245 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:07.755296 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f2dc6-eb73-4371-b1e4-3994005b0351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:07.756667 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2dc6-eb73-4371-b1e4-3994005b0351 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:07.757042 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2dc6-eb73-4371-b1e4-3994005b0351 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:07.757319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2dc6-eb73-4371-b1e4-3994005b0351 admin admin] PATH_INFO: `/v3/projects/3d63c2e381c14f8eaf6ca10f0e5f0612/users/0f09c8e3e1534020a6bb405c72dfcefd/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:07.759372 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f2dc6-eb73-4371-b1e4-3994005b0351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d63c2e381c14f8eaf6ca10f0e5f0612, user_id=0f09c8e3e1534020a6bb405c72dfcefd, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:07.762001 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f2dc6-eb73-4371-b1e4-3994005b0351 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:07.772311 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1138/2291] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:07 2021] PUT /identity/v3/projects/3d63c2e381c14f8eaf6ca10f0e5f0612/users/0f09c8e3e1534020a6bb405c72dfcefd/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:07.782018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea83584-073d-4b45-a586-5c755d6cd52f None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:07.782306 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea83584-073d-4b45-a586-5c755d6cd52f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:07.782577 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea83584-073d-4b45-a586-5c755d6cd52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:07.808177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-9ea83584-073d-4b45-a586-5c755d6cd52f None None] MFA Rules not processed for user `0f09c8e3e1534020a6bb405c72dfcefd`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:07.812893 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-9ea83584-073d-4b45-a586-5c755d6cd52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:07.876291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1154/2292] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:07 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:07.886483 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f2dc6-eb73-4371-b1e4-3994005b0351 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:07.888147 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-138f2dc6-eb73-4371-b1e4-3994005b0351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:07.943017 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f2dc6-eb73-4371-b1e4-3994005b0351 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:07.947433 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695300da-ed60-409d-b63d-c336e55276d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:07.948075 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695300da-ed60-409d-b63d-c336e55276d0 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:07.948356 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695300da-ed60-409d-b63d-c336e55276d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:07.948630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695300da-ed60-409d-b63d-c336e55276d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:08.002456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695300da-ed60-409d-b63d-c336e55276d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:08.003898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695300da-ed60-409d-b63d-c336e55276d0 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:08.013263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1139/2293] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:07 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:20.602772 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea83584-073d-4b45-a586-5c755d6cd52f None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:20.612351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea83584-073d-4b45-a586-5c755d6cd52f None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:20.615958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342fb53-bf9d-4a13-b8d6-164088c7a4f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:20.616597 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342fb53-bf9d-4a13-b8d6-164088c7a4f2 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:20.616877 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342fb53-bf9d-4a13-b8d6-164088c7a4f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:20.617155 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342fb53-bf9d-4a13-b8d6-164088c7a4f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:20.626414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342fb53-bf9d-4a13-b8d6-164088c7a4f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:20.627839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342fb53-bf9d-4a13-b8d6-164088c7a4f2 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:20.638591 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1155/2294] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:20 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:29.794596 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695300da-ed60-409d-b63d-c336e55276d0 service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:29.862582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695300da-ed60-409d-b63d-c336e55276d0 service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:29.867046 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:29.867956 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:29.868309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:29.872558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] PATH_INFO: `/v3/users/3712b9fa0c984323a58afa76e5fc3f6f` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:29.872558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3712b9fa0c984323a58afa76e5fc3f6f)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:29.872558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:30.106925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3712b9fa0c984323a58afa76e5fc3f6f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:30.107588 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3712b9fa0c984323a58afa76e5fc3f6f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:30.114333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3712b9fa0c984323a58afa76e5fc3f6f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:30.228513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3712b9fa0c984323a58afa76e5fc3f6f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:30.240522 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3712b9fa0c984323a58afa76e5fc3f6f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:30.246891 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1140/2295] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:40:29 2021] DELETE /identity/v3/users/3712b9fa0c984323a58afa76e5fc3f6f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:30.251565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df4dcd-6143-4cf7-bdfe-a7f1bd44de28 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:30.252089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df4dcd-6143-4cf7-bdfe-a7f1bd44de28 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:30.252382 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df4dcd-6143-4cf7-bdfe-a7f1bd44de28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:30.270606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d9df4dcd-6143-4cf7-bdfe-a7f1bd44de28 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:30.271797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d9df4dcd-6143-4cf7-bdfe-a7f1bd44de28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:30.332658 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1156/2296] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:30.340370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:30.342080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:30.402272 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c72b7-13c5-4d1b-b71a-6438323c2a93 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:30.405746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa9f84-3933-4318-bf73-e2a2933c0f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:30.406413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9f84-3933-4318-bf73-e2a2933c0f4b service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:30.406851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9f84-3933-4318-bf73-e2a2933c0f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:30.406962 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9f84-3933-4318-bf73-e2a2933c0f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:30.416232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa9f84-3933-4318-bf73-e2a2933c0f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:30.417665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa9f84-3933-4318-bf73-e2a2933c0f4b service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:30.426966 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1141/2297] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:30.829996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df4dcd-6143-4cf7-bdfe-a7f1bd44de28 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:30.834082 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d9df4dcd-6143-4cf7-bdfe-a7f1bd44de28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:30.847053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df4dcd-6143-4cf7-bdfe-a7f1bd44de28 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:30.853139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:30.854066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:30.854462 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:30.854605 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] PATH_INFO: `/v3/projects/2f8e896b4e5640b99aa94646d53b8e46` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:30.855791 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f8e896b4e5640b99aa94646d53b8e46)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:30.857848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:30.985212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f8e896b4e5640b99aa94646d53b8e46', 'request_id': 'req-7fb02068-1ff8-4937-8330-a49f1e550c3a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:31.062723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f8e896b4e5640b99aa94646d53b8e46', 'request_id': 'req-7fb02068-1ff8-4937-8330-a49f1e550c3a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:31.075735 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f8e896b4e5640b99aa94646d53b8e46', 'request_id': 'req-7fb02068-1ff8-4937-8330-a49f1e550c3a'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:31.080699 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] The token cache is being invalidate because project 2f8e896b4e5640b99aa94646d53b8e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:40:31.080988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:31.081646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:31.083297 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1157/2298] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:40:30 2021] DELETE /identity/v3/projects/2f8e896b4e5640b99aa94646d53b8e46 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:31.088993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa9f84-3933-4318-bf73-e2a2933c0f4b service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:31.099076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa9f84-3933-4318-bf73-e2a2933c0f4b service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:31.154484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3a33a-d4ee-49be-a4f6-d26d894f058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:31.161415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3a33a-d4ee-49be-a4f6-d26d894f058a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:31.161415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3a33a-d4ee-49be-a4f6-d26d894f058a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:31.161415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3a33a-d4ee-49be-a4f6-d26d894f058a admin admin] PATH_INFO: `/v3/users/0f09c8e3e1534020a6bb405c72dfcefd` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:31.161415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3a33a-d4ee-49be-a4f6-d26d894f058a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f09c8e3e1534020a6bb405c72dfcefd)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:31.161415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3a33a-d4ee-49be-a4f6-d26d894f058a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:31.386791 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-23b3a33a-d4ee-49be-a4f6-d26d894f058a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f09c8e3e1534020a6bb405c72dfcefd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:31.387751 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-23b3a33a-d4ee-49be-a4f6-d26d894f058a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f09c8e3e1534020a6bb405c72dfcefd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:31.395155 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-23b3a33a-d4ee-49be-a4f6-d26d894f058a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f09c8e3e1534020a6bb405c72dfcefd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:31.487702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-23b3a33a-d4ee-49be-a4f6-d26d894f058a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f09c8e3e1534020a6bb405c72dfcefd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:31.506081 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-23b3a33a-d4ee-49be-a4f6-d26d894f058a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f09c8e3e1534020a6bb405c72dfcefd'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:31.518074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1142/2299] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:40:31 2021] DELETE /identity/v3/users/0f09c8e3e1534020a6bb405c72dfcefd => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:31.972692 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:31.974467 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:31.992588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb02068-1ff8-4937-8330-a49f1e550c3a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:32.045830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c1668-abb2-4d55-a51e-455b84e11008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:32.046812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1668-abb2-4d55-a51e-455b84e11008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:32.047162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1668-abb2-4d55-a51e-455b84e11008 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:32.047505 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1668-abb2-4d55-a51e-455b84e11008 admin admin] PATH_INFO: `/v3/projects/3d63c2e381c14f8eaf6ca10f0e5f0612` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:32.048765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c1668-abb2-4d55-a51e-455b84e11008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d63c2e381c14f8eaf6ca10f0e5f0612)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:32.051059 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c1668-abb2-4d55-a51e-455b84e11008 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:32.193764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1a5c1668-abb2-4d55-a51e-455b84e11008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d63c2e381c14f8eaf6ca10f0e5f0612', 'request_id': 'req-1a5c1668-abb2-4d55-a51e-455b84e11008'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:32.313848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1a5c1668-abb2-4d55-a51e-455b84e11008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d63c2e381c14f8eaf6ca10f0e5f0612', 'request_id': 'req-1a5c1668-abb2-4d55-a51e-455b84e11008'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:32.319784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1a5c1668-abb2-4d55-a51e-455b84e11008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d63c2e381c14f8eaf6ca10f0e5f0612', 'request_id': 'req-1a5c1668-abb2-4d55-a51e-455b84e11008'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:32.331303 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1a5c1668-abb2-4d55-a51e-455b84e11008 admin admin] The token cache is being invalidate because project 3d63c2e381c14f8eaf6ca10f0e5f0612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:40:32.331589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1a5c1668-abb2-4d55-a51e-455b84e11008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:32.332206 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-1a5c1668-abb2-4d55-a51e-455b84e11008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:32.333710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1158/2300] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:40:31 2021] DELETE /identity/v3/projects/3d63c2e381c14f8eaf6ca10f0e5f0612 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:32.346696 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5589-f3c5-41b8-aef4-533be97d35b6 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:32.347192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5589-f3c5-41b8-aef4-533be97d35b6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:32.347297 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5589-f3c5-41b8-aef4-533be97d35b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:32.365225 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-a37d5589-f3c5-41b8-aef4-533be97d35b6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:32.368042 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a37d5589-f3c5-41b8-aef4-533be97d35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:32.423815 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1143/2301] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:32.432840 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd036e9a-b049-4566-a504-0a950c1d9c0b None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:32.433241 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd036e9a-b049-4566-a504-0a950c1d9c0b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:32.433523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd036e9a-b049-4566-a504-0a950c1d9c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:32.457238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-fd036e9a-b049-4566-a504-0a950c1d9c0b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:32.458461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-fd036e9a-b049-4566-a504-0a950c1d9c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:32.466460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1159/2302] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:32.470682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d5589-f3c5-41b8-aef4-533be97d35b6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:32.481121 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d5589-f3c5-41b8-aef4-533be97d35b6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:32.485795 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbba349-e6b6-4e65-bcfa-dea841dd08a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:32.486476 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbba349-e6b6-4e65-bcfa-dea841dd08a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:32.486762 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbba349-e6b6-4e65-bcfa-dea841dd08a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:32.487037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbba349-e6b6-4e65-bcfa-dea841dd08a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:32.487755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbba349-e6b6-4e65-bcfa-dea841dd08a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:40:32.488064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbba349-e6b6-4e65-bcfa-dea841dd08a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:32.489646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbba349-e6b6-4e65-bcfa-dea841dd08a7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:32.502022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1144/2303] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:40:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:40:32.507570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd036e9a-b049-4566-a504-0a950c1d9c0b None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:32.517297 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd036e9a-b049-4566-a504-0a950c1d9c0b None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:32.521882 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e0b43-2be1-4689-a52a-76bf6e223875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:32.522532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e0b43-2be1-4689-a52a-76bf6e223875 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:32.522811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e0b43-2be1-4689-a52a-76bf6e223875 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:32.523086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e0b43-2be1-4689-a52a-76bf6e223875 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:32.523764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e0b43-2be1-4689-a52a-76bf6e223875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:32.525670 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e0b43-2be1-4689-a52a-76bf6e223875 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:32.631572 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1160/2304] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:40:32 2021] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:40:32.635725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbba349-e6b6-4e65-bcfa-dea841dd08a7 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:32.645746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbba349-e6b6-4e65-bcfa-dea841dd08a7 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:32.701678 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1de536-0d09-4529-81d3-aa5e2a99aff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:32.702383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1de536-0d09-4529-81d3-aa5e2a99aff2 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:32.702665 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1de536-0d09-4529-81d3-aa5e2a99aff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:32.702939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1de536-0d09-4529-81d3-aa5e2a99aff2 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:32.703647 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1de536-0d09-4529-81d3-aa5e2a99aff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:32.705520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1de536-0d09-4529-81d3-aa5e2a99aff2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:32.811859 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1145/2305] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:40:32 2021] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:40:32.813332 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e0b43-2be1-4689-a52a-76bf6e223875 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:32.824256 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e0b43-2be1-4689-a52a-76bf6e223875 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:32.828958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e6d33-476d-46e0-afa2-40cda46b2460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:32.830570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e6d33-476d-46e0-afa2-40cda46b2460 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:32.830570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e6d33-476d-46e0-afa2-40cda46b2460 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:32.830570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e6d33-476d-46e0-afa2-40cda46b2460 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:32.831073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e6d33-476d-46e0-afa2-40cda46b2460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:32.832541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e6d33-476d-46e0-afa2-40cda46b2460 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:32.843185 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1161/2306] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:40:32.847223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1de536-0d09-4529-81d3-aa5e2a99aff2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:32.857689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1de536-0d09-4529-81d3-aa5e2a99aff2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:32.862302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31d2e4-f22d-4ebc-85ee-4122cc42b4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:32.862954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d2e4-f22d-4ebc-85ee-4122cc42b4bd admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:32.863235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d2e4-f22d-4ebc-85ee-4122cc42b4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:32.863509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d2e4-f22d-4ebc-85ee-4122cc42b4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:32.864233 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31d2e4-f22d-4ebc-85ee-4122cc42b4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:32.865798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31d2e4-f22d-4ebc-85ee-4122cc42b4bd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:32.876800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1146/2307] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:32.880796 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e6d33-476d-46e0-afa2-40cda46b2460 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:32.890606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e6d33-476d-46e0-afa2-40cda46b2460 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:32.895291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe61ec-6432-45c1-be53-39467fe11253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:32.896167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe61ec-6432-45c1-be53-39467fe11253 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:32.896440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe61ec-6432-45c1-be53-39467fe11253 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:32.896716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe61ec-6432-45c1-be53-39467fe11253 admin admin] PATH_INFO: `/v3/projects/bd4bae28f4a3438fbe00ffe1b674ea1b/users/4007dd6bfbfe4474875e35dc89d33643/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:32.911492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe61ec-6432-45c1-be53-39467fe11253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4bae28f4a3438fbe00ffe1b674ea1b, user_id=4007dd6bfbfe4474875e35dc89d33643, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:32.914230 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe61ec-6432-45c1-be53-39467fe11253 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:32.997457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1162/2308] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:32 2021] PUT /identity/v3/projects/bd4bae28f4a3438fbe00ffe1b674ea1b/users/4007dd6bfbfe4474875e35dc89d33643/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:33.009155 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c8c09-2575-4bc4-86d2-6bb0377f7c22 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:33.009460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c8c09-2575-4bc4-86d2-6bb0377f7c22 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:33.009709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c8c09-2575-4bc4-86d2-6bb0377f7c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:33.038695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-838c8c09-2575-4bc4-86d2-6bb0377f7c22 None None] MFA Rules not processed for user `4007dd6bfbfe4474875e35dc89d33643`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:33.040916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-838c8c09-2575-4bc4-86d2-6bb0377f7c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:33.109619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1147/2309] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:33 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:33.110651 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe61ec-6432-45c1-be53-39467fe11253 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:33.112385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-15fe61ec-6432-45c1-be53-39467fe11253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:33.124865 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c8c09-2575-4bc4-86d2-6bb0377f7c22 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:33.126573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-838c8c09-2575-4bc4-86d2-6bb0377f7c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:33.184731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c8c09-2575-4bc4-86d2-6bb0377f7c22 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:33.185348 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe61ec-6432-45c1-be53-39467fe11253 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:33.188393 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284d8bf-da82-494f-82ab-fe609d96b0e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:33.189010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284d8bf-da82-494f-82ab-fe609d96b0e0 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:33.189286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284d8bf-da82-494f-82ab-fe609d96b0e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:33.189557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284d8bf-da82-494f-82ab-fe609d96b0e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:33.190002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5e5f1-a647-48d9-9b05-c2b6dd34351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:33.190858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5e5f1-a647-48d9-9b05-c2b6dd34351d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:33.191134 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5e5f1-a647-48d9-9b05-c2b6dd34351d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:33.191407 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5e5f1-a647-48d9-9b05-c2b6dd34351d admin admin] PATH_INFO: `/v3/users/2ddc7e1ea4254d2c9703e0be937707b8` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:33.192622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5e5f1-a647-48d9-9b05-c2b6dd34351d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ddc7e1ea4254d2c9703e0be937707b8)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:33.194558 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5e5f1-a647-48d9-9b05-c2b6dd34351d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:33.197838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284d8bf-da82-494f-82ab-fe609d96b0e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:33.199362 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284d8bf-da82-494f-82ab-fe609d96b0e0 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:33.208167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1148/2310] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:33 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:40:33.257528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284d8bf-da82-494f-82ab-fe609d96b0e0 service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:33.268771 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284d8bf-da82-494f-82ab-fe609d96b0e0 service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:33.273488 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75da18-e7a8-4d32-bf42-84b923fe3882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:33.275091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75da18-e7a8-4d32-bf42-84b923fe3882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:33.275369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75da18-e7a8-4d32-bf42-84b923fe3882 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:33.275641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75da18-e7a8-4d32-bf42-84b923fe3882 admin admin] PATH_INFO: `/v3/users/4007dd6bfbfe4474875e35dc89d33643` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:33.276832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75da18-e7a8-4d32-bf42-84b923fe3882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4007dd6bfbfe4474875e35dc89d33643)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:33.278764 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75da18-e7a8-4d32-bf42-84b923fe3882 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:33.362071 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-9fa5e5f1-a647-48d9-9b05-c2b6dd34351d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ddc7e1ea4254d2c9703e0be937707b8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:33.362774 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-9fa5e5f1-a647-48d9-9b05-c2b6dd34351d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ddc7e1ea4254d2c9703e0be937707b8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:33.363424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-9fa5e5f1-a647-48d9-9b05-c2b6dd34351d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ddc7e1ea4254d2c9703e0be937707b8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:33.430813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-9fa5e5f1-a647-48d9-9b05-c2b6dd34351d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ddc7e1ea4254d2c9703e0be937707b8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:33.442754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-9fa5e5f1-a647-48d9-9b05-c2b6dd34351d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ddc7e1ea4254d2c9703e0be937707b8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:33.455019 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1c75da18-e7a8-4d32-bf42-84b923fe3882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4007dd6bfbfe4474875e35dc89d33643'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:33.455694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1163/2311] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:40:33 2021] DELETE /identity/v3/users/2ddc7e1ea4254d2c9703e0be937707b8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:33.458893 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1c75da18-e7a8-4d32-bf42-84b923fe3882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4007dd6bfbfe4474875e35dc89d33643'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:33.460131 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfac89-8e9f-4da9-afd4-754afbdd4331 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:33.460413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfac89-8e9f-4da9-afd4-754afbdd4331 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:33.460683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfac89-8e9f-4da9-afd4-754afbdd4331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:33.463399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1c75da18-e7a8-4d32-bf42-84b923fe3882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4007dd6bfbfe4474875e35dc89d33643'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:33.479572 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d7cfac89-8e9f-4da9-afd4-754afbdd4331 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:33.480813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d7cfac89-8e9f-4da9-afd4-754afbdd4331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:33.531446 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1c75da18-e7a8-4d32-bf42-84b923fe3882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4007dd6bfbfe4474875e35dc89d33643'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:33.537290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1164/2312] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:33.544290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-1c75da18-e7a8-4d32-bf42-84b923fe3882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4007dd6bfbfe4474875e35dc89d33643'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:33.547314 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfac89-8e9f-4da9-afd4-754afbdd4331 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:33.548957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d7cfac89-8e9f-4da9-afd4-754afbdd4331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:33.550497 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1149/2313] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:40:33 2021] DELETE /identity/v3/users/4007dd6bfbfe4474875e35dc89d33643 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:33.554636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53952-6b79-4d7f-ba21-8e0348bbb5ee None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:33.554977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53952-6b79-4d7f-ba21-8e0348bbb5ee None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:33.555332 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53952-6b79-4d7f-ba21-8e0348bbb5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:33.572989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c9d53952-6b79-4d7f-ba21-8e0348bbb5ee None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:33.574209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c9d53952-6b79-4d7f-ba21-8e0348bbb5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:33.605740 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfac89-8e9f-4da9-afd4-754afbdd4331 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:33.629085 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1150/2314] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:33.639929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53952-6b79-4d7f-ba21-8e0348bbb5ee None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:33.641285 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c9d53952-6b79-4d7f-ba21-8e0348bbb5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:33.653166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11531661-9bbb-4792-93ea-87f514f112d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:33.653810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531661-9bbb-4792-93ea-87f514f112d6 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:33.654162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531661-9bbb-4792-93ea-87f514f112d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:33.654434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531661-9bbb-4792-93ea-87f514f112d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:33.656216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-11531661-9bbb-4792-93ea-87f514f112d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:33.668568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11531661-9bbb-4792-93ea-87f514f112d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:33.670018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11531661-9bbb-4792-93ea-87f514f112d6 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:33.679460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1165/2315] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:40:33.696392 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53952-6b79-4d7f-ba21-8e0348bbb5ee None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:33.700025 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b12ea6-d2b2-4566-a13c-822da7794358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:33.700663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12ea6-d2b2-4566-a13c-822da7794358 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:33.700936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12ea6-d2b2-4566-a13c-822da7794358 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:33.701203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12ea6-d2b2-4566-a13c-822da7794358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:33.710141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b12ea6-d2b2-4566-a13c-822da7794358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:33.711723 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b12ea6-d2b2-4566-a13c-822da7794358 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:33.721185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1151/2316] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:40:34.092841 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11531661-9bbb-4792-93ea-87f514f112d6 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:34.093979 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-11531661-9bbb-4792-93ea-87f514f112d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:34.124173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11531661-9bbb-4792-93ea-87f514f112d6 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:34.134549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:34.135379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:34.135652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:34.136266 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] PATH_INFO: `/v3/projects/2deccf035b0549478a79dbc799030da6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:34.137512 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2deccf035b0549478a79dbc799030da6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:34.143061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:34.276321 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2deccf035b0549478a79dbc799030da6', 'request_id': 'req-6d2437a0-0af1-496c-b821-b643668948f0'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.319914 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b12ea6-d2b2-4566-a13c-822da7794358 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:34.321415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-05b12ea6-d2b2-4566-a13c-822da7794358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:34.334071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b12ea6-d2b2-4566-a13c-822da7794358 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:34.350822 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2deccf035b0549478a79dbc799030da6', 'request_id': 'req-6d2437a0-0af1-496c-b821-b643668948f0'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.357578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2deccf035b0549478a79dbc799030da6', 'request_id': 'req-6d2437a0-0af1-496c-b821-b643668948f0'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.370280 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] The token cache is being invalidate because project 2deccf035b0549478a79dbc799030da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:40:34.370571 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.371222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.373049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1166/2317] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:40:34 2021] DELETE /identity/v3/projects/2deccf035b0549478a79dbc799030da6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:34.376670 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:34.377981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:34.391167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f68435-b4af-495b-8fde-3ff4308f8caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:34.392016 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f68435-b4af-495b-8fde-3ff4308f8caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:34.392290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f68435-b4af-495b-8fde-3ff4308f8caa admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:34.392590 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f68435-b4af-495b-8fde-3ff4308f8caa admin admin] PATH_INFO: `/v3/projects/bd4bae28f4a3438fbe00ffe1b674ea1b` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:34.393749 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f68435-b4af-495b-8fde-3ff4308f8caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4bae28f4a3438fbe00ffe1b674ea1b)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:34.395652 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f68435-b4af-495b-8fde-3ff4308f8caa admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:34.445656 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2437a0-0af1-496c-b821-b643668948f0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:34.450883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:34.451763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:34.452050 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:34.452354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] PATH_INFO: `/v3/users/0350d05620b14ba0b5ce9e4ec4b11e02` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:34.453553 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0350d05620b14ba0b5ce9e4ec4b11e02)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:34.455621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:34.507343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-58f68435-b4af-495b-8fde-3ff4308f8caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4bae28f4a3438fbe00ffe1b674ea1b', 'request_id': 'req-58f68435-b4af-495b-8fde-3ff4308f8caa'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.576438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-58f68435-b4af-495b-8fde-3ff4308f8caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4bae28f4a3438fbe00ffe1b674ea1b', 'request_id': 'req-58f68435-b4af-495b-8fde-3ff4308f8caa'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.582589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-58f68435-b4af-495b-8fde-3ff4308f8caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4bae28f4a3438fbe00ffe1b674ea1b', 'request_id': 'req-58f68435-b4af-495b-8fde-3ff4308f8caa'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.594420 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-58f68435-b4af-495b-8fde-3ff4308f8caa admin admin] The token cache is being invalidate because project bd4bae28f4a3438fbe00ffe1b674ea1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:40:34.594708 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-58f68435-b4af-495b-8fde-3ff4308f8caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.595340 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-58f68435-b4af-495b-8fde-3ff4308f8caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.596847 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1152/2318] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:40:34 2021] DELETE /identity/v3/projects/bd4bae28f4a3438fbe00ffe1b674ea1b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:34.603830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a868e6f-60db-4220-b759-a7df5321151a None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:34.604111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a868e6f-60db-4220-b759-a7df5321151a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:34.604431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a868e6f-60db-4220-b759-a7df5321151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:34.621449 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-4a868e6f-60db-4220-b759-a7df5321151a None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:34.622662 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4a868e6f-60db-4220-b759-a7df5321151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:34.678139 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1153/2319] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:34.683783 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0350d05620b14ba0b5ce9e4ec4b11e02'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.684431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0350d05620b14ba0b5ce9e4ec4b11e02'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.685035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0350d05620b14ba0b5ce9e4ec4b11e02'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.686094 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fcef2-7064-4367-bee5-524b83d50908 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:34.686383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fcef2-7064-4367-bee5-524b83d50908 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:34.686752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fcef2-7064-4367-bee5-524b83d50908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:34.706113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-af7fcef2-7064-4367-bee5-524b83d50908 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:34.707305 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-af7fcef2-7064-4367-bee5-524b83d50908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:34.715707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1154/2320] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:34.719922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fcef2-7064-4367-bee5-524b83d50908 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:34.728161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0350d05620b14ba0b5ce9e4ec4b11e02'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.729948 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fcef2-7064-4367-bee5-524b83d50908 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:34.734535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90338057-f097-4c4d-a05d-b01e29ceaaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:34.735168 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90338057-f097-4c4d-a05d-b01e29ceaaea admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:34.735445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90338057-f097-4c4d-a05d-b01e29ceaaea admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:34.735717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90338057-f097-4c4d-a05d-b01e29ceaaea admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:34.736417 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90338057-f097-4c4d-a05d-b01e29ceaaea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:40:34.736717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90338057-f097-4c4d-a05d-b01e29ceaaea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:34.738320 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90338057-f097-4c4d-a05d-b01e29ceaaea admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:34.740117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0350d05620b14ba0b5ce9e4ec4b11e02'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:34.750165 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1155/2321] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:40:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:40:34.754338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90338057-f097-4c4d-a05d-b01e29ceaaea admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:34.755289 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1167/2322] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:40:34 2021] DELETE /identity/v3/users/0350d05620b14ba0b5ce9e4ec4b11e02 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:34.765245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90338057-f097-4c4d-a05d-b01e29ceaaea admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:34.822172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd1585-2613-4d32-bf48-99bbeeac3cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:34.822824 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd1585-2613-4d32-bf48-99bbeeac3cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:34.823201 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd1585-2613-4d32-bf48-99bbeeac3cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:34.823478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd1585-2613-4d32-bf48-99bbeeac3cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:34.824166 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd1585-2613-4d32-bf48-99bbeeac3cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:34.826134 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd1585-2613-4d32-bf48-99bbeeac3cc5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:34.901104 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1156/2323] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:40:34 2021] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:40:34.905309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:34.915607 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391d6b6-8103-4e5c-8804-022529b871be admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:34.975458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e993928-25e2-4f47-bc36-8198365147bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:34.976132 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e993928-25e2-4f47-bc36-8198365147bf admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:34.976409 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e993928-25e2-4f47-bc36-8198365147bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:34.976701 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e993928-25e2-4f47-bc36-8198365147bf admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:34.977682 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e993928-25e2-4f47-bc36-8198365147bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:34.979655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e993928-25e2-4f47-bc36-8198365147bf admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:35.063767 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1168/2324] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:40:34 2021] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:40:35.068870 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd1585-2613-4d32-bf48-99bbeeac3cc5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:35.079692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd1585-2613-4d32-bf48-99bbeeac3cc5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:35.084231 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae4eaf-ae43-40fb-bd5a-ac0712ebccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:35.084922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4eaf-ae43-40fb-bd5a-ac0712ebccd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:35.085195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4eaf-ae43-40fb-bd5a-ac0712ebccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:35.085467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4eaf-ae43-40fb-bd5a-ac0712ebccd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:35.086987 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae4eaf-ae43-40fb-bd5a-ac0712ebccd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:35.088710 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae4eaf-ae43-40fb-bd5a-ac0712ebccd5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:35.098983 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1157/2325] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:35.103181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e993928-25e2-4f47-bc36-8198365147bf admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:35.112896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e993928-25e2-4f47-bc36-8198365147bf admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:35.117472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82320cc-01be-464f-9061-7322e497f43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:35.118179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82320cc-01be-464f-9061-7322e497f43c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:35.118461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82320cc-01be-464f-9061-7322e497f43c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:35.118729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82320cc-01be-464f-9061-7322e497f43c admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:35.119436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82320cc-01be-464f-9061-7322e497f43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:35.121008 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82320cc-01be-464f-9061-7322e497f43c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:35.131159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1169/2326] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:35 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:35.143263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae4eaf-ae43-40fb-bd5a-ac0712ebccd5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:35.153727 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae4eaf-ae43-40fb-bd5a-ac0712ebccd5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:35.158648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6a31f-abaf-4bdb-a396-809ffd14f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:35.159518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6a31f-abaf-4bdb-a396-809ffd14f667 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:35.159798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6a31f-abaf-4bdb-a396-809ffd14f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:35.160073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6a31f-abaf-4bdb-a396-809ffd14f667 admin admin] PATH_INFO: `/v3/projects/236affd94e314d68a10b2decd9cafcd1/users/0adbeb55b1054c2daf6932831854a4a7/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:35.175179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82320cc-01be-464f-9061-7322e497f43c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:35.177099 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a82320cc-01be-464f-9061-7322e497f43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:35.180545 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6a31f-abaf-4bdb-a396-809ffd14f667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236affd94e314d68a10b2decd9cafcd1, user_id=0adbeb55b1054c2daf6932831854a4a7, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:35.181606 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6a31f-abaf-4bdb-a396-809ffd14f667 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:35.192304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82320cc-01be-464f-9061-7322e497f43c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:35.198183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee88f0-b02f-4806-9d9a-0537b60a0db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:35.199121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee88f0-b02f-4806-9d9a-0537b60a0db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:35.199408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee88f0-b02f-4806-9d9a-0537b60a0db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:35.199912 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee88f0-b02f-4806-9d9a-0537b60a0db1 admin admin] PATH_INFO: `/v3/projects/a0dca21548d643f5a0f9116ac4bb44eb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:35.201118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee88f0-b02f-4806-9d9a-0537b60a0db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0dca21548d643f5a0f9116ac4bb44eb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:35.203062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee88f0-b02f-4806-9d9a-0537b60a0db1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:35.277760 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1158/2327] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:35 2021] PUT /identity/v3/projects/236affd94e314d68a10b2decd9cafcd1/users/0adbeb55b1054c2daf6932831854a4a7/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:35.282819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbdf9c-f8e1-428e-a3be-7055ea6dd781 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:35.283115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbdf9c-f8e1-428e-a3be-7055ea6dd781 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:35.283388 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbdf9c-f8e1-428e-a3be-7055ea6dd781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:35.300932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-a1fbdf9c-f8e1-428e-a3be-7055ea6dd781 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:35.302145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a1fbdf9c-f8e1-428e-a3be-7055ea6dd781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:35.324052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0cee88f0-b02f-4806-9d9a-0537b60a0db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0dca21548d643f5a0f9116ac4bb44eb', 'request_id': 'req-0cee88f0-b02f-4806-9d9a-0537b60a0db1'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:35.361107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1159/2328] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:35.371726 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbdf9c-f8e1-428e-a3be-7055ea6dd781 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:35.373198 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a1fbdf9c-f8e1-428e-a3be-7055ea6dd781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:35.413898 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0cee88f0-b02f-4806-9d9a-0537b60a0db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0dca21548d643f5a0f9116ac4bb44eb', 'request_id': 'req-0cee88f0-b02f-4806-9d9a-0537b60a0db1'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:35.422244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0cee88f0-b02f-4806-9d9a-0537b60a0db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0dca21548d643f5a0f9116ac4bb44eb', 'request_id': 'req-0cee88f0-b02f-4806-9d9a-0537b60a0db1'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:35.436858 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0cee88f0-b02f-4806-9d9a-0537b60a0db1 admin admin] The token cache is being invalidate because project a0dca21548d643f5a0f9116ac4bb44eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:40:35.437169 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0cee88f0-b02f-4806-9d9a-0537b60a0db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:35.437824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-0cee88f0-b02f-4806-9d9a-0537b60a0db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:35.439759 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1170/2329] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:40:35 2021] DELETE /identity/v3/projects/a0dca21548d643f5a0f9116ac4bb44eb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:35.441635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbdf9c-f8e1-428e-a3be-7055ea6dd781 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:35.446179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8f92c-cf67-4351-9dcc-204b563a8134 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:35.446484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8f92c-cf67-4351-9dcc-204b563a8134 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:35.447433 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8f92c-cf67-4351-9dcc-204b563a8134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:35.468491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3fd8f92c-cf67-4351-9dcc-204b563a8134 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:35.468491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3fd8f92c-cf67-4351-9dcc-204b563a8134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:35.496830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb18f2-629d-47dd-a148-e6c7f1234bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:35.497481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb18f2-629d-47dd-a148-e6c7f1234bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:35.497758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb18f2-629d-47dd-a148-e6c7f1234bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:35.498056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb18f2-629d-47dd-a148-e6c7f1234bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:35.500009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d5fb18f2-629d-47dd-a148-e6c7f1234bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:35.528522 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1171/2330] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:35.538348 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace970c5-0f03-4da3-a609-4e8a8808a883 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:35.538637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace970c5-0f03-4da3-a609-4e8a8808a883 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:35.538917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace970c5-0f03-4da3-a609-4e8a8808a883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:35.556737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-ace970c5-0f03-4da3-a609-4e8a8808a883 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:35.557952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-ace970c5-0f03-4da3-a609-4e8a8808a883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:35.560830 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb18f2-629d-47dd-a148-e6c7f1234bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:35.562313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb18f2-629d-47dd-a148-e6c7f1234bd6 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:35.565713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1172/2331] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:35.569706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace970c5-0f03-4da3-a609-4e8a8808a883 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:35.573131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1160/2332] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:40:35.578907 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace970c5-0f03-4da3-a609-4e8a8808a883 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:35.583537 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf8e8f-a5c6-417f-b2e9-409b81dd1eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:35.584299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf8e8f-a5c6-417f-b2e9-409b81dd1eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:35.584583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf8e8f-a5c6-417f-b2e9-409b81dd1eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:35.584902 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf8e8f-a5c6-417f-b2e9-409b81dd1eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:35.585622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf8e8f-a5c6-417f-b2e9-409b81dd1eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:40:35.585951 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf8e8f-a5c6-417f-b2e9-409b81dd1eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:35.588285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf8e8f-a5c6-417f-b2e9-409b81dd1eb0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:35.600216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1173/2333] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:40:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:40:35.609174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb18f2-629d-47dd-a148-e6c7f1234bd6 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:35.618724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb18f2-629d-47dd-a148-e6c7f1234bd6 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:35.623376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51724b5-716e-48a8-ab30-e143a53d2e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:35.624015 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51724b5-716e-48a8-ab30-e143a53d2e13 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:35.624291 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51724b5-716e-48a8-ab30-e143a53d2e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:35.624565 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51724b5-716e-48a8-ab30-e143a53d2e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:35.625239 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51724b5-716e-48a8-ab30-e143a53d2e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:35.627135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51724b5-716e-48a8-ab30-e143a53d2e13 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:35.828418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1161/2334] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:40:35 2021] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:40:35.829224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf8e8f-a5c6-417f-b2e9-409b81dd1eb0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:35.834588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf8e8f-a5c6-417f-b2e9-409b81dd1eb0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:35.893212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3e392-6e2d-4b1a-a561-e40c26a06d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:35.893944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3e392-6e2d-4b1a-a561-e40c26a06d7b admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:35.894251 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3e392-6e2d-4b1a-a561-e40c26a06d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:35.894528 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3e392-6e2d-4b1a-a561-e40c26a06d7b admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:35.895220 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3e392-6e2d-4b1a-a561-e40c26a06d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:35.897245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3e392-6e2d-4b1a-a561-e40c26a06d7b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:36.002854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1174/2335] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:40:35 2021] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:40:36.007078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51724b5-716e-48a8-ab30-e143a53d2e13 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:36.018336 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51724b5-716e-48a8-ab30-e143a53d2e13 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:36.022921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd799d-76e3-4607-b97c-1664919b99f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:36.023718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd799d-76e3-4607-b97c-1664919b99f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:36.024004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd799d-76e3-4607-b97c-1664919b99f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:36.024347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd799d-76e3-4607-b97c-1664919b99f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:36.025270 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd799d-76e3-4607-b97c-1664919b99f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:36.035471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd799d-76e3-4607-b97c-1664919b99f5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:36.038798 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1162/2336] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:36.042726 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3e392-6e2d-4b1a-a561-e40c26a06d7b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:36.057691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3e392-6e2d-4b1a-a561-e40c26a06d7b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:36.063861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545df4d2-d9c5-4daa-824a-b9329d6c9990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:36.063861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df4d2-d9c5-4daa-824a-b9329d6c9990 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:36.063861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df4d2-d9c5-4daa-824a-b9329d6c9990 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:36.063861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df4d2-d9c5-4daa-824a-b9329d6c9990 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:36.064496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545df4d2-d9c5-4daa-824a-b9329d6c9990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:36.066120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545df4d2-d9c5-4daa-824a-b9329d6c9990 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:36.077079 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1175/2337] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:36 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:40:36.081428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd799d-76e3-4607-b97c-1664919b99f5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:36.093414 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd799d-76e3-4607-b97c-1664919b99f5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:36.098929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd506c-5ee7-4d1a-ba20-18e2fa6df0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:36.099474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd506c-5ee7-4d1a-ba20-18e2fa6df0d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:36.099695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd506c-5ee7-4d1a-ba20-18e2fa6df0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:36.099972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd506c-5ee7-4d1a-ba20-18e2fa6df0d2 admin admin] PATH_INFO: `/v3/projects/97a5f092947f4035818bcce40cc63618/users/bcc737f668744cbc91d68cc1ace283e3/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:36.114879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd506c-5ee7-4d1a-ba20-18e2fa6df0d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a5f092947f4035818bcce40cc63618, user_id=bcc737f668744cbc91d68cc1ace283e3, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:36.117834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd506c-5ee7-4d1a-ba20-18e2fa6df0d2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:36.261607 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1163/2338] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:36 2021] PUT /identity/v3/projects/97a5f092947f4035818bcce40cc63618/users/bcc737f668744cbc91d68cc1ace283e3/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:36.271282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20a89e-3fd5-4f98-94e8-8dbd58a36399 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:36.272438 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20a89e-3fd5-4f98-94e8-8dbd58a36399 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:36.272964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20a89e-3fd5-4f98-94e8-8dbd58a36399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:36.301552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-6f20a89e-3fd5-4f98-94e8-8dbd58a36399 None None] MFA Rules not processed for user `bcc737f668744cbc91d68cc1ace283e3`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:36.302895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-6f20a89e-3fd5-4f98-94e8-8dbd58a36399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:36.374476 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1176/2339] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:36 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:36.379003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd506c-5ee7-4d1a-ba20-18e2fa6df0d2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:36.459655 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd506c-5ee7-4d1a-ba20-18e2fa6df0d2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:36.465777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbf47a-817b-440d-a62e-e6cd5a8e79bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:36.466627 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbf47a-817b-440d-a62e-e6cd5a8e79bd admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:36.466914 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbf47a-817b-440d-a62e-e6cd5a8e79bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:36.467186 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbf47a-817b-440d-a62e-e6cd5a8e79bd admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:36.467882 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbf47a-817b-440d-a62e-e6cd5a8e79bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:36.475236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbf47a-817b-440d-a62e-e6cd5a8e79bd admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:36.588944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20a89e-3fd5-4f98-94e8-8dbd58a36399 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:36.594424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1164/2340] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:40:36 2021] POST /identity/v3/projects => generated 363 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:40:36.600035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20a89e-3fd5-4f98-94e8-8dbd58a36399 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:36.668992 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e2fa3-3dbe-4035-9a19-8f5b05763d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:36.669677 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2fa3-3dbe-4035-9a19-8f5b05763d56 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:36.669993 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2fa3-3dbe-4035-9a19-8f5b05763d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:36.670272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2fa3-3dbe-4035-9a19-8f5b05763d56 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:36.670975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e2fa3-3dbe-4035-9a19-8f5b05763d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:36.672912 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e2fa3-3dbe-4035-9a19-8f5b05763d56 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:36.814109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1177/2341] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:40:36 2021] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:40:36.814551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbf47a-817b-440d-a62e-e6cd5a8e79bd admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:36.825283 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbf47a-817b-440d-a62e-e6cd5a8e79bd admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:36.830853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344622f1-4c6c-4187-8dcb-fa55489327c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:36.831488 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344622f1-4c6c-4187-8dcb-fa55489327c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:36.831861 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344622f1-4c6c-4187-8dcb-fa55489327c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:36.832042 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344622f1-4c6c-4187-8dcb-fa55489327c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:36.832770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344622f1-4c6c-4187-8dcb-fa55489327c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:36.834425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344622f1-4c6c-4187-8dcb-fa55489327c7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:36.846435 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1165/2342] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:36.850665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e2fa3-3dbe-4035-9a19-8f5b05763d56 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:36.873210 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e2fa3-3dbe-4035-9a19-8f5b05763d56 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:36.885752 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef27c8a-5736-44ec-a237-f86e4d07d0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:36.886709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef27c8a-5736-44ec-a237-f86e4d07d0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:36.886989 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef27c8a-5736-44ec-a237-f86e4d07d0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:36.887260 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef27c8a-5736-44ec-a237-f86e4d07d0f9 admin admin] PATH_INFO: `/v3/projects/14871e5057c34bebb5593679990520eb/users/5291e0b1df654d5fb30216edc2b20ebf/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:36.907983 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef27c8a-5736-44ec-a237-f86e4d07d0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14871e5057c34bebb5593679990520eb, user_id=5291e0b1df654d5fb30216edc2b20ebf, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:36.910959 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef27c8a-5736-44ec-a237-f86e4d07d0f9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:37.008529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1178/2343] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:36 2021] PUT /identity/v3/projects/14871e5057c34bebb5593679990520eb/users/5291e0b1df654d5fb30216edc2b20ebf/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:37.013085 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344622f1-4c6c-4187-8dcb-fa55489327c7 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:37.024370 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344622f1-4c6c-4187-8dcb-fa55489327c7 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:37.095744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4ba42-b008-4311-891c-312437908740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:37.097447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4ba42-b008-4311-891c-312437908740 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:37.097447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4ba42-b008-4311-891c-312437908740 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:37.097758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4ba42-b008-4311-891c-312437908740 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:37.098960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4ba42-b008-4311-891c-312437908740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:37.102472 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4ba42-b008-4311-891c-312437908740 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:37.114247 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1166/2344] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:37 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:40:37.118497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef27c8a-5736-44ec-a237-f86e4d07d0f9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:37.141084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef27c8a-5736-44ec-a237-f86e4d07d0f9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:37.147447 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91306791-36ea-41b5-a618-2c9e91738aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:37.148346 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91306791-36ea-41b5-a618-2c9e91738aef admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:37.148626 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91306791-36ea-41b5-a618-2c9e91738aef admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:37.149360 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91306791-36ea-41b5-a618-2c9e91738aef admin admin] PATH_INFO: `/v3/projects/14871e5057c34bebb5593679990520eb/users/5291e0b1df654d5fb30216edc2b20ebf/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:37.152334 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91306791-36ea-41b5-a618-2c9e91738aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=14871e5057c34bebb5593679990520eb, user_id=5291e0b1df654d5fb30216edc2b20ebf, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:37.155124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91306791-36ea-41b5-a618-2c9e91738aef admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:37.167815 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1179/2345] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:37 2021] PUT /identity/v3/projects/14871e5057c34bebb5593679990520eb/users/5291e0b1df654d5fb30216edc2b20ebf/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:37.178532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92c36-4463-4612-8384-7200e9e7db80 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:37.178815 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92c36-4463-4612-8384-7200e9e7db80 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:37.179094 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92c36-4463-4612-8384-7200e9e7db80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:37.207467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-6fd92c36-4463-4612-8384-7200e9e7db80 None None] MFA Rules not processed for user `5291e0b1df654d5fb30216edc2b20ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:37.208990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-6fd92c36-4463-4612-8384-7200e9e7db80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:37.281237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1167/2346] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:37 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:37.291786 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91306791-36ea-41b5-a618-2c9e91738aef admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:37.293819 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-91306791-36ea-41b5-a618-2c9e91738aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:37.372880 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91306791-36ea-41b5-a618-2c9e91738aef admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:37.377555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77633a-d487-4c2b-8e2b-d71567433fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:37.378295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77633a-d487-4c2b-8e2b-d71567433fac service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:37.378610 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77633a-d487-4c2b-8e2b-d71567433fac service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:37.378916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77633a-d487-4c2b-8e2b-d71567433fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:37.393276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77633a-d487-4c2b-8e2b-d71567433fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:37.395347 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77633a-d487-4c2b-8e2b-d71567433fac service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:37.409938 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1180/2347] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:37 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:37.717683 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd92c36-4463-4612-8384-7200e9e7db80 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:37.746180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd92c36-4463-4612-8384-7200e9e7db80 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:37.752700 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b1fd4-6433-46a2-9ddb-423f3e629d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:37.753407 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b1fd4-6433-46a2-9ddb-423f3e629d3b service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:37.753686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b1fd4-6433-46a2-9ddb-423f3e629d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:37.754004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b1fd4-6433-46a2-9ddb-423f3e629d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:37.832748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b1fd4-6433-46a2-9ddb-423f3e629d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:37.834677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b1fd4-6433-46a2-9ddb-423f3e629d3b service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:37.859897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1168/2348] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:37 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:41.934161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9da1-14fd-4cd5-a7cb-f79521a6c07c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:41.935064 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9da1-14fd-4cd5-a7cb-f79521a6c07c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:41.935567 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9da1-14fd-4cd5-a7cb-f79521a6c07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:41.968612 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-643c9da1-14fd-4cd5-a7cb-f79521a6c07c None None] MFA Rules not processed for user `0adbeb55b1054c2daf6932831854a4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:41.970370 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-643c9da1-14fd-4cd5-a7cb-f79521a6c07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:42.043297 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1181/2349] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:41 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:42.048935 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b1fd4-6433-46a2-9ddb-423f3e629d3b service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:42.050716 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-212b1fd4-6433-46a2-9ddb-423f3e629d3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:42.127696 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b1fd4-6433-46a2-9ddb-423f3e629d3b service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:42.134061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c10de-d1ab-490f-afab-eec40a47b220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:42.134973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c10de-d1ab-490f-afab-eec40a47b220 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:42.135433 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c10de-d1ab-490f-afab-eec40a47b220 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:42.135709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c10de-d1ab-490f-afab-eec40a47b220 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:42.136518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c10de-d1ab-490f-afab-eec40a47b220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:42.138502 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c10de-d1ab-490f-afab-eec40a47b220 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:42.212020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729e3f4-93a8-4341-975a-d916eb4ce1e2 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:42.213132 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729e3f4-93a8-4341-975a-d916eb4ce1e2 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:42.213488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729e3f4-93a8-4341-975a-d916eb4ce1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:42.233349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0729e3f4-93a8-4341-975a-d916eb4ce1e2 None None] MFA Rules not processed for user `9f616dad20824b21927f4f6a2a9abaad`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:42.233790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1169/2350] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:40:42 2021] POST /identity/v3/projects => generated 371 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:40:42.235033 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c10de-d1ab-490f-afab-eec40a47b220 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:42.235174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0729e3f4-93a8-4341-975a-d916eb4ce1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:42.299983 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1182/2351] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:42 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:42.316585 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c10de-d1ab-490f-afab-eec40a47b220 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:42.321421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b24f82-df62-4985-a525-6d009ac200ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:42.322741 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b24f82-df62-4985-a525-6d009ac200ce admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:42.323024 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b24f82-df62-4985-a525-6d009ac200ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:42.323298 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b24f82-df62-4985-a525-6d009ac200ce admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:42.323984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b24f82-df62-4985-a525-6d009ac200ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:42.325957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b24f82-df62-4985-a525-6d009ac200ce admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:42.443895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1170/2352] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:40:42 2021] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:40:42.448356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729e3f4-93a8-4341-975a-d916eb4ce1e2 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:42.464285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729e3f4-93a8-4341-975a-d916eb4ce1e2 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:42.471341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2738b3-d74a-4f41-ad80-792c97ed96f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:42.474586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2738b3-d74a-4f41-ad80-792c97ed96f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:42.474586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2738b3-d74a-4f41-ad80-792c97ed96f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:42.474586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2738b3-d74a-4f41-ad80-792c97ed96f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:42.475100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2738b3-d74a-4f41-ad80-792c97ed96f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:42.477169 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2738b3-d74a-4f41-ad80-792c97ed96f8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:42.489918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1183/2353] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:42 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:42.494139 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b24f82-df62-4985-a525-6d009ac200ce admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:42.505764 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b24f82-df62-4985-a525-6d009ac200ce admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:42.512192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccff72b-dd8a-4549-a2dd-807f46ec3623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:42.513100 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccff72b-dd8a-4549-a2dd-807f46ec3623 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:42.513802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccff72b-dd8a-4549-a2dd-807f46ec3623 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:42.518159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccff72b-dd8a-4549-a2dd-807f46ec3623 admin admin] PATH_INFO: `/v3/projects/c6a477f2fe9247dda16e104af2119881/users/2b55b6a77ab84e4c928f3d4ad910f5d4/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:42.537957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccff72b-dd8a-4549-a2dd-807f46ec3623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a477f2fe9247dda16e104af2119881, user_id=2b55b6a77ab84e4c928f3d4ad910f5d4, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:42.540928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccff72b-dd8a-4549-a2dd-807f46ec3623 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:42.645832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1171/2354] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:42 2021] PUT /identity/v3/projects/c6a477f2fe9247dda16e104af2119881/users/2b55b6a77ab84e4c928f3d4ad910f5d4/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:42.647885 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2738b3-d74a-4f41-ad80-792c97ed96f8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:42.668900 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2738b3-d74a-4f41-ad80-792c97ed96f8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:42.745716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fc9ef-bd48-4c87-b4d7-bd6ed19f3547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:42.746516 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fc9ef-bd48-4c87-b4d7-bd6ed19f3547 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:42.746932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fc9ef-bd48-4c87-b4d7-bd6ed19f3547 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:42.747210 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fc9ef-bd48-4c87-b4d7-bd6ed19f3547 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:42.747929 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fc9ef-bd48-4c87-b4d7-bd6ed19f3547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:42.749529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fc9ef-bd48-4c87-b4d7-bd6ed19f3547 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:42.763908 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1184/2355] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:42 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:40:42.768044 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccff72b-dd8a-4549-a2dd-807f46ec3623 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:42.779406 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccff72b-dd8a-4549-a2dd-807f46ec3623 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:42.785009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d43583-c52a-4754-a148-035e9dc634a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:42.785462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d43583-c52a-4754-a148-035e9dc634a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:42.785742 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d43583-c52a-4754-a148-035e9dc634a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:42.786061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d43583-c52a-4754-a148-035e9dc634a4 admin admin] PATH_INFO: `/v3/projects/c6a477f2fe9247dda16e104af2119881/users/2b55b6a77ab84e4c928f3d4ad910f5d4/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:42.788289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d43583-c52a-4754-a148-035e9dc634a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a477f2fe9247dda16e104af2119881, user_id=2b55b6a77ab84e4c928f3d4ad910f5d4, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:42.792000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d43583-c52a-4754-a148-035e9dc634a4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:42.803857 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1172/2356] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:42 2021] PUT /identity/v3/projects/c6a477f2fe9247dda16e104af2119881/users/2b55b6a77ab84e4c928f3d4ad910f5d4/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:43.454268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf642b-f2a5-4a80-9f4c-186bdcd5a68e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:43.455023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf642b-f2a5-4a80-9f4c-186bdcd5a68e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:43.455317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf642b-f2a5-4a80-9f4c-186bdcd5a68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:43.497981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0fcf642b-f2a5-4a80-9f4c-186bdcd5a68e None None] MFA Rules not processed for user `304ebf23ad9c47eeba8baec42e096a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:43.499586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0fcf642b-f2a5-4a80-9f4c-186bdcd5a68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:43.564295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1185/2357] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:43 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:44.871850 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d43583-c52a-4754-a148-035e9dc634a4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:44.880449 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b4d43583-c52a-4754-a148-035e9dc634a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:45.005199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d43583-c52a-4754-a148-035e9dc634a4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:45.011388 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7983fa9-9d98-40fc-8839-484dd081cf86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:45.012297 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7983fa9-9d98-40fc-8839-484dd081cf86 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:45.012762 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7983fa9-9d98-40fc-8839-484dd081cf86 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:45.013203 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7983fa9-9d98-40fc-8839-484dd081cf86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:45.015970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b7983fa9-9d98-40fc-8839-484dd081cf86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:45.126228 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7983fa9-9d98-40fc-8839-484dd081cf86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:45.127759 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7983fa9-9d98-40fc-8839-484dd081cf86 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:45.143934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1173/2358] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:44 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:46.275953 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf642b-f2a5-4a80-9f4c-186bdcd5a68e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:46.288283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf642b-f2a5-4a80-9f4c-186bdcd5a68e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:46.298329 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ece0-e982-4dac-ba98-4a2f56a292ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:46.299005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ece0-e982-4dac-ba98-4a2f56a292ff service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:46.299293 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ece0-e982-4dac-ba98-4a2f56a292ff service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:46.299572 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ece0-e982-4dac-ba98-4a2f56a292ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:46.301400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a342ece0-e982-4dac-ba98-4a2f56a292ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:46.320796 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342ece0-e982-4dac-ba98-4a2f56a292ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:46.322550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342ece0-e982-4dac-ba98-4a2f56a292ff service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:46.334039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1186/2359] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:49.892087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb54655-0802-4545-8252-ec7d95cb50bb None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:49.892617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb54655-0802-4545-8252-ec7d95cb50bb None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:49.892699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb54655-0802-4545-8252-ec7d95cb50bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:49.935034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0cb54655-0802-4545-8252-ec7d95cb50bb None None] MFA Rules not processed for user `2b55b6a77ab84e4c928f3d4ad910f5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:49.936613 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0cb54655-0802-4545-8252-ec7d95cb50bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:50.082431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1174/2360] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:49 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:50.095086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ece0-e982-4dac-ba98-4a2f56a292ff service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:50.098011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a342ece0-e982-4dac-ba98-4a2f56a292ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:50.121545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ece0-e982-4dac-ba98-4a2f56a292ff service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:50.133341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf1499-66d2-44ad-bb29-3a46bfb0325e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:50.134736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf1499-66d2-44ad-bb29-3a46bfb0325e service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:50.135290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf1499-66d2-44ad-bb29-3a46bfb0325e service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:50.135889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf1499-66d2-44ad-bb29-3a46bfb0325e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:50.222215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf1499-66d2-44ad-bb29-3a46bfb0325e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:50.225349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf1499-66d2-44ad-bb29-3a46bfb0325e service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:50.238043 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1187/2361] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:50 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:52.010208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb54655-0802-4545-8252-ec7d95cb50bb None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:52.139114 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb54655-0802-4545-8252-ec7d95cb50bb None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:52.147599 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:52.148883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:52.149323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:52.151591 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] PATH_INFO: `/v3/users/bcc737f668744cbc91d68cc1ace283e3` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:52.151591 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc737f668744cbc91d68cc1ace283e3)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:52.153331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:52.449188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc737f668744cbc91d68cc1ace283e3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:52.449963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc737f668744cbc91d68cc1ace283e3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:52.458318 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc737f668744cbc91d68cc1ace283e3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:52.529916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc737f668744cbc91d68cc1ace283e3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:52.546424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc737f668744cbc91d68cc1ace283e3'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:52.552487 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1175/2362] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:40:52 2021] DELETE /identity/v3/users/bcc737f668744cbc91d68cc1ace283e3 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:52.557724 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67675e18-1c5a-427b-a0e1-6538cf4e1f30 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:52.558244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67675e18-1c5a-427b-a0e1-6538cf4e1f30 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:52.558503 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67675e18-1c5a-427b-a0e1-6538cf4e1f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:52.577451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-67675e18-1c5a-427b-a0e1-6538cf4e1f30 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:52.578791 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-67675e18-1c5a-427b-a0e1-6538cf4e1f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:52.648899 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1188/2363] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:52.660444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:52.662193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:52.774121 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0a847-143b-4f79-a50d-29a1dead1cbc admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:52.779061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de173f66-f8f3-47d5-b09b-b3c1afd1fdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:52.779841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de173f66-f8f3-47d5-b09b-b3c1afd1fdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:52.780250 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de173f66-f8f3-47d5-b09b-b3c1afd1fdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:52.780596 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de173f66-f8f3-47d5-b09b-b3c1afd1fdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:52.790745 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de173f66-f8f3-47d5-b09b-b3c1afd1fdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:52.792328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de173f66-f8f3-47d5-b09b-b3c1afd1fdf9 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:52.802629 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1176/2364] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:53.562486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67675e18-1c5a-427b-a0e1-6538cf4e1f30 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:53.565199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-67675e18-1c5a-427b-a0e1-6538cf4e1f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:53.584089 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67675e18-1c5a-427b-a0e1-6538cf4e1f30 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:53.593678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9febb-0bbc-433d-8319-f9a02ee7ba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:53.595285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9febb-0bbc-433d-8319-f9a02ee7ba60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:53.596012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9febb-0bbc-433d-8319-f9a02ee7ba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:53.596446 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9febb-0bbc-433d-8319-f9a02ee7ba60 admin admin] PATH_INFO: `/v3/projects/97a5f092947f4035818bcce40cc63618` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:53.598594 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9febb-0bbc-433d-8319-f9a02ee7ba60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a5f092947f4035818bcce40cc63618)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:53.601514 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9febb-0bbc-433d-8319-f9a02ee7ba60 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:53.763544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-dca9febb-0bbc-433d-8319-f9a02ee7ba60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a5f092947f4035818bcce40cc63618', 'request_id': 'req-dca9febb-0bbc-433d-8319-f9a02ee7ba60'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:53.825091 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-dca9febb-0bbc-433d-8319-f9a02ee7ba60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a5f092947f4035818bcce40cc63618', 'request_id': 'req-dca9febb-0bbc-433d-8319-f9a02ee7ba60'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:53.834151 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-dca9febb-0bbc-433d-8319-f9a02ee7ba60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a5f092947f4035818bcce40cc63618', 'request_id': 'req-dca9febb-0bbc-433d-8319-f9a02ee7ba60'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:53.853956 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-dca9febb-0bbc-433d-8319-f9a02ee7ba60 admin admin] The token cache is being invalidate because project 97a5f092947f4035818bcce40cc63618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:40:53.854558 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-dca9febb-0bbc-433d-8319-f9a02ee7ba60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:53.855845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-dca9febb-0bbc-433d-8319-f9a02ee7ba60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:53.861343 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1189/2365] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:40:53 2021] DELETE /identity/v3/projects/97a5f092947f4035818bcce40cc63618 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:53.862294 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de173f66-f8f3-47d5-b09b-b3c1afd1fdf9 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:53.874966 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de173f66-f8f3-47d5-b09b-b3c1afd1fdf9 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:53.944560 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:53.945738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:53.946141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:53.946535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] PATH_INFO: `/v3/users/5291e0b1df654d5fb30216edc2b20ebf` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:53.947927 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5291e0b1df654d5fb30216edc2b20ebf)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:53.950242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:54.483913 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5291e0b1df654d5fb30216edc2b20ebf'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:54.485234 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5291e0b1df654d5fb30216edc2b20ebf'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:54.493187 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5291e0b1df654d5fb30216edc2b20ebf'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:54.591013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5291e0b1df654d5fb30216edc2b20ebf'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:54.667828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5291e0b1df654d5fb30216edc2b20ebf'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:54.667828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1177/2366] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:40:53 2021] DELETE /identity/v3/users/5291e0b1df654d5fb30216edc2b20ebf => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:55.092126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c965a-461b-40ae-9d82-a5a31f187d2b None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:55.092685 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c965a-461b-40ae-9d82-a5a31f187d2b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:55.092685 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c965a-461b-40ae-9d82-a5a31f187d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:55.113593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-f92c965a-461b-40ae-9d82-a5a31f187d2b None None] MFA Rules not processed for user `0adbeb55b1054c2daf6932831854a4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:55.114880 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f92c965a-461b-40ae-9d82-a5a31f187d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:55.174619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1190/2367] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:55 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:55.199410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:55.200852 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:55.334692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c934d9b-af86-482e-a0cc-bfc2d58fd2d4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:55.340968 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cf98b-7dbf-426c-a9ce-842f061f7e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:55.342104 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cf98b-7dbf-426c-a9ce-842f061f7e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:55.342451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cf98b-7dbf-426c-a9ce-842f061f7e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:55.342818 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cf98b-7dbf-426c-a9ce-842f061f7e1d admin admin] PATH_INFO: `/v3/projects/14871e5057c34bebb5593679990520eb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:55.344164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cf98b-7dbf-426c-a9ce-842f061f7e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14871e5057c34bebb5593679990520eb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:55.346440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cf98b-7dbf-426c-a9ce-842f061f7e1d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:55.475794 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-484cf98b-7dbf-426c-a9ce-842f061f7e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14871e5057c34bebb5593679990520eb', 'request_id': 'req-484cf98b-7dbf-426c-a9ce-842f061f7e1d'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:55.574088 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-484cf98b-7dbf-426c-a9ce-842f061f7e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14871e5057c34bebb5593679990520eb', 'request_id': 'req-484cf98b-7dbf-426c-a9ce-842f061f7e1d'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:55.582226 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-484cf98b-7dbf-426c-a9ce-842f061f7e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14871e5057c34bebb5593679990520eb', 'request_id': 'req-484cf98b-7dbf-426c-a9ce-842f061f7e1d'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:55.601179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-484cf98b-7dbf-426c-a9ce-842f061f7e1d admin admin] The token cache is being invalidate because project 14871e5057c34bebb5593679990520eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:40:55.601497 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-484cf98b-7dbf-426c-a9ce-842f061f7e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:55.608497 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-484cf98b-7dbf-426c-a9ce-842f061f7e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:40:55.608497 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1178/2368] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:40:55 2021] DELETE /identity/v3/projects/14871e5057c34bebb5593679990520eb => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:55.611875 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f123e-841d-48b9-b8b7-40be14e1eaf8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:55.612358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f123e-841d-48b9-b8b7-40be14e1eaf8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:55.612826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f123e-841d-48b9-b8b7-40be14e1eaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:55.641086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-744f123e-841d-48b9-b8b7-40be14e1eaf8 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:55.643646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-744f123e-841d-48b9-b8b7-40be14e1eaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:55.734931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1191/2369] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:55.742829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada8db4-f9e3-47df-a943-95c9f5f7de1f None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:55.743024 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada8db4-f9e3-47df-a943-95c9f5f7de1f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:55.743494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada8db4-f9e3-47df-a943-95c9f5f7de1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:55.772070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-8ada8db4-f9e3-47df-a943-95c9f5f7de1f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:55.772070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8ada8db4-f9e3-47df-a943-95c9f5f7de1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:55.781900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1179/2370] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:55.786324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f123e-841d-48b9-b8b7-40be14e1eaf8 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:55.797560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f123e-841d-48b9-b8b7-40be14e1eaf8 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:55.802850 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de212c79-d1fe-4d45-a571-650779c8f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:55.803626 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de212c79-d1fe-4d45-a571-650779c8f902 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:55.803973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de212c79-d1fe-4d45-a571-650779c8f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:55.804311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de212c79-d1fe-4d45-a571-650779c8f902 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:55.805134 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de212c79-d1fe-4d45-a571-650779c8f902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:40:55.805500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de212c79-d1fe-4d45-a571-650779c8f902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:55.807642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de212c79-d1fe-4d45-a571-650779c8f902 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:55.820326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1192/2371] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:40:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:40:55.824775 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada8db4-f9e3-47df-a943-95c9f5f7de1f None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:55.834991 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada8db4-f9e3-47df-a943-95c9f5f7de1f None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:55.847150 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461108a-3414-4a18-b70b-3fa923eb2ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:55.848060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461108a-3414-4a18-b70b-3fa923eb2ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:55.848506 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461108a-3414-4a18-b70b-3fa923eb2ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:55.848811 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461108a-3414-4a18-b70b-3fa923eb2ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:55.849845 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461108a-3414-4a18-b70b-3fa923eb2ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:55.851838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461108a-3414-4a18-b70b-3fa923eb2ce1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:55.942091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1180/2372] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:40:55 2021] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:40:55.943616 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de212c79-d1fe-4d45-a571-650779c8f902 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:55.964899 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de212c79-d1fe-4d45-a571-650779c8f902 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:56.053471 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f92c9-6740-4642-8e52-c590af0510da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:56.055010 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f92c9-6740-4642-8e52-c590af0510da admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:56.055561 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f92c9-6740-4642-8e52-c590af0510da admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:56.056761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f92c9-6740-4642-8e52-c590af0510da admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:56.057696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f92c9-6740-4642-8e52-c590af0510da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:56.059898 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f92c9-6740-4642-8e52-c590af0510da admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:56.192257 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1193/2373] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:40:55 2021] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:40:56.197901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461108a-3414-4a18-b70b-3fa923eb2ce1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:56.220907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461108a-3414-4a18-b70b-3fa923eb2ce1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:56.248990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492e039-9b15-43ae-9638-f0cb5a72efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:56.248990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492e039-9b15-43ae-9638-f0cb5a72efda admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:56.248990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492e039-9b15-43ae-9638-f0cb5a72efda admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:56.248990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492e039-9b15-43ae-9638-f0cb5a72efda admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:56.249389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492e039-9b15-43ae-9638-f0cb5a72efda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:56.251313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492e039-9b15-43ae-9638-f0cb5a72efda admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:56.265795 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1181/2374] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:56 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:56.270046 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f92c9-6740-4642-8e52-c590af0510da admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:56.281298 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f92c9-6740-4642-8e52-c590af0510da admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:56.286180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a5827-d7e4-4ae9-aaab-47e400e273d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:56.286912 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5827-d7e4-4ae9-aaab-47e400e273d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:56.287262 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5827-d7e4-4ae9-aaab-47e400e273d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:56.287632 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5827-d7e4-4ae9-aaab-47e400e273d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:56.288419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a5827-d7e4-4ae9-aaab-47e400e273d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:56.290199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a5827-d7e4-4ae9-aaab-47e400e273d4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:56.301162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1194/2375] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:56 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:56.304924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492e039-9b15-43ae-9638-f0cb5a72efda admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:56.318022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492e039-9b15-43ae-9638-f0cb5a72efda admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:56.324851 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc068b-6e4d-4db9-8428-5ca15c0d91d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:56.325778 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc068b-6e4d-4db9-8428-5ca15c0d91d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:56.327307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc068b-6e4d-4db9-8428-5ca15c0d91d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:56.327604 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc068b-6e4d-4db9-8428-5ca15c0d91d4 admin admin] PATH_INFO: `/v3/projects/8999d05844d940fab31dbc67a99ef629/users/0104da0e1e25465eba1f89eab3030e21/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:56.343115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc068b-6e4d-4db9-8428-5ca15c0d91d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8999d05844d940fab31dbc67a99ef629, user_id=0104da0e1e25465eba1f89eab3030e21, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:56.346064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc068b-6e4d-4db9-8428-5ca15c0d91d4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:56.435501 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1182/2376] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:56 2021] PUT /identity/v3/projects/8999d05844d940fab31dbc67a99ef629/users/0104da0e1e25465eba1f89eab3030e21/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:40:56.446024 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3b7a2-8801-4cf0-9ab7-1a4071ef368d None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:56.446401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3b7a2-8801-4cf0-9ab7-1a4071ef368d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:56.447278 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3b7a2-8801-4cf0-9ab7-1a4071ef368d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:56.479023 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-efa3b7a2-8801-4cf0-9ab7-1a4071ef368d None None] MFA Rules not processed for user `0104da0e1e25465eba1f89eab3030e21`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:56.480234 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-efa3b7a2-8801-4cf0-9ab7-1a4071ef368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:56.562817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1195/2377] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:56 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:56.568174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc068b-6e4d-4db9-8428-5ca15c0d91d4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:56.635675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc068b-6e4d-4db9-8428-5ca15c0d91d4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:56.640565 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483390d5-eac8-496a-ad7b-83af00df2d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:56.641221 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483390d5-eac8-496a-ad7b-83af00df2d3b admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:56.641501 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483390d5-eac8-496a-ad7b-83af00df2d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:56.641772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483390d5-eac8-496a-ad7b-83af00df2d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:56.642484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483390d5-eac8-496a-ad7b-83af00df2d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:56.644527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483390d5-eac8-496a-ad7b-83af00df2d3b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:56.764526 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1183/2378] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:40:56 2021] POST /identity/v3/projects => generated 391 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:40:56.765798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3b7a2-8801-4cf0-9ab7-1a4071ef368d None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:56.779196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3b7a2-8801-4cf0-9ab7-1a4071ef368d None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:56.845629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa42af-e6b7-46ea-8f5d-d1b660fb57ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:56.846344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa42af-e6b7-46ea-8f5d-d1b660fb57ab admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:56.846629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa42af-e6b7-46ea-8f5d-d1b660fb57ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:56.846908 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa42af-e6b7-46ea-8f5d-d1b660fb57ab admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:56.847583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa42af-e6b7-46ea-8f5d-d1b660fb57ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:56.849759 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa42af-e6b7-46ea-8f5d-d1b660fb57ab admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:56.940645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1196/2379] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:40:56 2021] POST /identity/v3/users => generated 302 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:40:56.944487 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483390d5-eac8-496a-ad7b-83af00df2d3b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:56.966534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483390d5-eac8-496a-ad7b-83af00df2d3b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:56.972142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0aad9-bdf2-4282-99c8-565500f92629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:56.972825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0aad9-bdf2-4282-99c8-565500f92629 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:56.973114 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0aad9-bdf2-4282-99c8-565500f92629 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:56.973390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0aad9-bdf2-4282-99c8-565500f92629 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:56.974423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0aad9-bdf2-4282-99c8-565500f92629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:56.976133 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0aad9-bdf2-4282-99c8-565500f92629 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:56.989437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1184/2380] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:56 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:56.994080 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa42af-e6b7-46ea-8f5d-d1b660fb57ab admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:57.005817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa42af-e6b7-46ea-8f5d-d1b660fb57ab admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:57.011307 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d055aff-bb9d-41a5-9d51-78382b7464be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:57.012299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d055aff-bb9d-41a5-9d51-78382b7464be admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:57.016164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d055aff-bb9d-41a5-9d51-78382b7464be admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:57.016164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d055aff-bb9d-41a5-9d51-78382b7464be admin admin] PATH_INFO: `/v3/projects/8b150aefe4334262bcfff6579d596aa8/users/6b0f393a020941a285cecdeb173e6625/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:57.029487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d055aff-bb9d-41a5-9d51-78382b7464be admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b150aefe4334262bcfff6579d596aa8, user_id=6b0f393a020941a285cecdeb173e6625, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:57.032294 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d055aff-bb9d-41a5-9d51-78382b7464be admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:57.177546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1197/2381] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:56 2021] PUT /identity/v3/projects/8b150aefe4334262bcfff6579d596aa8/users/6b0f393a020941a285cecdeb173e6625/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:57.182135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0aad9-bdf2-4282-99c8-565500f92629 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:57.191988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0aad9-bdf2-4282-99c8-565500f92629 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:57.249428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e258-db3e-4832-a9db-49ffd8468530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:57.250191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e258-db3e-4832-a9db-49ffd8468530 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:57.250473 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e258-db3e-4832-a9db-49ffd8468530 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:57.250748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e258-db3e-4832-a9db-49ffd8468530 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:57.251479 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69e258-db3e-4832-a9db-49ffd8468530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:57.256332 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69e258-db3e-4832-a9db-49ffd8468530 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:57.271902 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1185/2382] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:40:57 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:40:57.273284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d055aff-bb9d-41a5-9d51-78382b7464be admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:57.285221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d055aff-bb9d-41a5-9d51-78382b7464be admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:57.290214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d0ef3-fb90-4772-b6ae-b0ac887f84a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:57.291171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d0ef3-fb90-4772-b6ae-b0ac887f84a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:57.291527 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d0ef3-fb90-4772-b6ae-b0ac887f84a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:57.291873 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d0ef3-fb90-4772-b6ae-b0ac887f84a6 admin admin] PATH_INFO: `/v3/projects/8b150aefe4334262bcfff6579d596aa8/users/6b0f393a020941a285cecdeb173e6625/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:57.294028 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d0ef3-fb90-4772-b6ae-b0ac887f84a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b150aefe4334262bcfff6579d596aa8, user_id=6b0f393a020941a285cecdeb173e6625, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:57.296737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d0ef3-fb90-4772-b6ae-b0ac887f84a6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:57.309814 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1198/2383] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:40:57 2021] PUT /identity/v3/projects/8b150aefe4334262bcfff6579d596aa8/users/6b0f393a020941a285cecdeb173e6625/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:40:57.321131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f1f47-9824-4c56-a526-4c13b17c8a64 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:57.322067 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f1f47-9824-4c56-a526-4c13b17c8a64 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:57.322410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f1f47-9824-4c56-a526-4c13b17c8a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:57.351029 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c30f1f47-9824-4c56-a526-4c13b17c8a64 None None] MFA Rules not processed for user `6b0f393a020941a285cecdeb173e6625`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:57.352339 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c30f1f47-9824-4c56-a526-4c13b17c8a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:57.433816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1186/2384] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:57 2021] POST /identity/v3/auth/tokens => generated 3478 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:40:57.449987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d0ef3-fb90-4772-b6ae-b0ac887f84a6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:57.451753 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-520d0ef3-fb90-4772-b6ae-b0ac887f84a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:57.517277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d0ef3-fb90-4772-b6ae-b0ac887f84a6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:57.521302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee9662-f29f-47e2-b97b-b3dcba8f5ef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:57.522007 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee9662-f29f-47e2-b97b-b3dcba8f5ef8 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:57.522291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee9662-f29f-47e2-b97b-b3dcba8f5ef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:57.522566 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee9662-f29f-47e2-b97b-b3dcba8f5ef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:57.533676 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee9662-f29f-47e2-b97b-b3dcba8f5ef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:57.535184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee9662-f29f-47e2-b97b-b3dcba8f5ef8 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:57.546082 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1199/2385] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:57 2021] GET /identity/v3/auth/tokens => generated 3478 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:57.593737 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f1f47-9824-4c56-a526-4c13b17c8a64 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:57.595840 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c30f1f47-9824-4c56-a526-4c13b17c8a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:57.608586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f1f47-9824-4c56-a526-4c13b17c8a64 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:57.612256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c783ed0-20d8-4157-b011-a756b76dca6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:57.612925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c783ed0-20d8-4157-b011-a756b76dca6c service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:57.613202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c783ed0-20d8-4157-b011-a756b76dca6c service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:57.613501 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c783ed0-20d8-4157-b011-a756b76dca6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:57.669895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c783ed0-20d8-4157-b011-a756b76dca6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:57.671315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c783ed0-20d8-4157-b011-a756b76dca6c service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:57.679926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1187/2386] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:57 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:40:57.711427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd6ce6-491d-4fb6-867f-56864989adf4 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:57.711713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd6ce6-491d-4fb6-867f-56864989adf4 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:57.712036 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd6ce6-491d-4fb6-867f-56864989adf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:57.730181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-a3cd6ce6-491d-4fb6-867f-56864989adf4 None None] MFA Rules not processed for user `c60cd9a36fad47d98458b8c0e28f3ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:40:57.731388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a3cd6ce6-491d-4fb6-867f-56864989adf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:57.788827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1200/2387] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:40:57 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:40:58.625364 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c783ed0-20d8-4157-b011-a756b76dca6c service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:40:58.626804 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-9c783ed0-20d8-4157-b011-a756b76dca6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:58.711614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c783ed0-20d8-4157-b011-a756b76dca6c service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:40:58.717200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c89fa0-e326-42d5-9152-2a5a8ed6a36b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77a408df11844e2aacbb366019dc3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:40:58.717971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c89fa0-e326-42d5-9152-2a5a8ed6a36b service placement] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:40:58.718450 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c89fa0-e326-42d5-9152-2a5a8ed6a36b service placement] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:40:58.718803 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c89fa0-e326-42d5-9152-2a5a8ed6a36b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:40:58.721071 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-62c89fa0-e326-42d5-9152-2a5a8ed6a36b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:40:58.735266 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c89fa0-e326-42d5-9152-2a5a8ed6a36b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:40:58.741799 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c89fa0-e326-42d5-9152-2a5a8ed6a36b service placement] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:40:58.749351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1188/2388] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:40:58 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:41:02.383990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd6ce6-491d-4fb6-867f-56864989adf4 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:02.387579 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a3cd6ce6-491d-4fb6-867f-56864989adf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:02.395698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c89fa0-e326-42d5-9152-2a5a8ed6a36b service placement] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:02.401654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-62c89fa0-e326-42d5-9152-2a5a8ed6a36b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:02.484598 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd6ce6-491d-4fb6-867f-56864989adf4 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:02.496619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca692a-1a7e-484f-a94e-fc4829ec60fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:02.497290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca692a-1a7e-484f-a94e-fc4829ec60fb service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:02.497568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca692a-1a7e-484f-a94e-fc4829ec60fb service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:02.497837 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca692a-1a7e-484f-a94e-fc4829ec60fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:02.505590 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-79ca692a-1a7e-484f-a94e-fc4829ec60fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:02.518915 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca692a-1a7e-484f-a94e-fc4829ec60fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:02.521282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca692a-1a7e-484f-a94e-fc4829ec60fb service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:02.530916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c89fa0-e326-42d5-9152-2a5a8ed6a36b service placement] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:02.532360 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1201/2389] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:02 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:41:02.536329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460e6d0-9293-4c24-8c3d-b828fe9f7b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:02.536999 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460e6d0-9293-4c24-8c3d-b828fe9f7b3d service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:02.537280 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460e6d0-9293-4c24-8c3d-b828fe9f7b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:02.537614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460e6d0-9293-4c24-8c3d-b828fe9f7b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:02.546664 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460e6d0-9293-4c24-8c3d-b828fe9f7b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:02.548170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460e6d0-9293-4c24-8c3d-b828fe9f7b3d service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:02.558704 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1189/2390] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:02 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:41:02.844415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca692a-1a7e-484f-a94e-fc4829ec60fb service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:02.920353 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca692a-1a7e-484f-a94e-fc4829ec60fb service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:02.925620 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:02.926633 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:02.926973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:02.927309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] PATH_INFO: `/v3/users/0104da0e1e25465eba1f89eab3030e21` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:02.928985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0104da0e1e25465eba1f89eab3030e21)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:02.934529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:03.206766 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0104da0e1e25465eba1f89eab3030e21'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:03.207585 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0104da0e1e25465eba1f89eab3030e21'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:03.208215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0104da0e1e25465eba1f89eab3030e21'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:03.301501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0104da0e1e25465eba1f89eab3030e21'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:03.317296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0104da0e1e25465eba1f89eab3030e21'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:03.335106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1202/2391] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:41:02 2021] DELETE /identity/v3/users/0104da0e1e25465eba1f89eab3030e21 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:41:03.340286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3dad8-09d0-4091-88af-a140b4742502 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:03.340579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3dad8-09d0-4091-88af-a140b4742502 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:03.340859 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3dad8-09d0-4091-88af-a140b4742502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:03.365699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0bc3dad8-09d0-4091-88af-a140b4742502 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:41:03.367003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0bc3dad8-09d0-4091-88af-a140b4742502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:03.440058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1190/2392] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:41:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:41:03.451237 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:03.452675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:03.548084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd99493-3ea4-4ec3-9fe7-ec2da33faec8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:03.553584 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53eb0b-56b5-419a-b02c-f61c5994527c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:03.557884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53eb0b-56b5-419a-b02c-f61c5994527c service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:03.557884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53eb0b-56b5-419a-b02c-f61c5994527c service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:03.557884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53eb0b-56b5-419a-b02c-f61c5994527c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:03.568196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53eb0b-56b5-419a-b02c-f61c5994527c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:03.570316 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53eb0b-56b5-419a-b02c-f61c5994527c service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:03.590075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1203/2393] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:41:04.238682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3dad8-09d0-4091-88af-a140b4742502 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:04.239758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0bc3dad8-09d0-4091-88af-a140b4742502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:04.254060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3dad8-09d0-4091-88af-a140b4742502 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:04.259541 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:04.261006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:04.261278 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:04.261919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] PATH_INFO: `/v3/projects/8999d05844d940fab31dbc67a99ef629` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:04.263890 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8999d05844d940fab31dbc67a99ef629)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:04.266717 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:04.416208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8999d05844d940fab31dbc67a99ef629', 'request_id': 'req-3ef13996-6a24-4532-a362-edd2b55c9170'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:04.476377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8999d05844d940fab31dbc67a99ef629', 'request_id': 'req-3ef13996-6a24-4532-a362-edd2b55c9170'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:04.483816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8999d05844d940fab31dbc67a99ef629', 'request_id': 'req-3ef13996-6a24-4532-a362-edd2b55c9170'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:04.495451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] The token cache is being invalidate because project 8999d05844d940fab31dbc67a99ef629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:41:04.500431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:04.500431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:04.500431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1191/2394] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:41:04 2021] DELETE /identity/v3/projects/8999d05844d940fab31dbc67a99ef629 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:41:04.503079 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53eb0b-56b5-419a-b02c-f61c5994527c service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:04.513153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53eb0b-56b5-419a-b02c-f61c5994527c service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:04.581596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d71dd-e035-444f-8f49-7fcbb94dfd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:04.582501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d71dd-e035-444f-8f49-7fcbb94dfd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:04.586304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d71dd-e035-444f-8f49-7fcbb94dfd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:04.586304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d71dd-e035-444f-8f49-7fcbb94dfd46 admin admin] PATH_INFO: `/v3/users/6b0f393a020941a285cecdeb173e6625` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:04.586304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d71dd-e035-444f-8f49-7fcbb94dfd46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0f393a020941a285cecdeb173e6625)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:04.587639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d71dd-e035-444f-8f49-7fcbb94dfd46 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:04.812886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-b68d71dd-e035-444f-8f49-7fcbb94dfd46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0f393a020941a285cecdeb173e6625'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:04.813562 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-b68d71dd-e035-444f-8f49-7fcbb94dfd46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0f393a020941a285cecdeb173e6625'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:04.814174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-b68d71dd-e035-444f-8f49-7fcbb94dfd46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0f393a020941a285cecdeb173e6625'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:04.917236 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-b68d71dd-e035-444f-8f49-7fcbb94dfd46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0f393a020941a285cecdeb173e6625'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:04.941407 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-b68d71dd-e035-444f-8f49-7fcbb94dfd46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0f393a020941a285cecdeb173e6625'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:04.957581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1204/2395] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:41:04 2021] DELETE /identity/v3/users/6b0f393a020941a285cecdeb173e6625 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:41:05.518266 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:05.519741 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:05.534201 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef13996-6a24-4532-a362-edd2b55c9170 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:05.591623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec1671-7fd1-4239-b3f6-194d9c686a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:05.591990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec1671-7fd1-4239-b3f6-194d9c686a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:05.592270 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec1671-7fd1-4239-b3f6-194d9c686a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:05.592543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec1671-7fd1-4239-b3f6-194d9c686a35 admin admin] PATH_INFO: `/v3/projects/8b150aefe4334262bcfff6579d596aa8` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:05.593709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec1671-7fd1-4239-b3f6-194d9c686a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b150aefe4334262bcfff6579d596aa8)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:05.595637 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec1671-7fd1-4239-b3f6-194d9c686a35 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:05.728455 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b3ec1671-7fd1-4239-b3f6-194d9c686a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b150aefe4334262bcfff6579d596aa8', 'request_id': 'req-b3ec1671-7fd1-4239-b3f6-194d9c686a35'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:05.793881 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b3ec1671-7fd1-4239-b3f6-194d9c686a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b150aefe4334262bcfff6579d596aa8', 'request_id': 'req-b3ec1671-7fd1-4239-b3f6-194d9c686a35'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:05.799307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b3ec1671-7fd1-4239-b3f6-194d9c686a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b150aefe4334262bcfff6579d596aa8', 'request_id': 'req-b3ec1671-7fd1-4239-b3f6-194d9c686a35'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:05.810195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b3ec1671-7fd1-4239-b3f6-194d9c686a35 admin admin] The token cache is being invalidate because project 8b150aefe4334262bcfff6579d596aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:41:05.810555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b3ec1671-7fd1-4239-b3f6-194d9c686a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:05.811170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b3ec1671-7fd1-4239-b3f6-194d9c686a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:05.812675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1192/2396] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:41:05 2021] DELETE /identity/v3/projects/8b150aefe4334262bcfff6579d596aa8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:41:05.818826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed3d0-4b67-4f97-a42a-5ef51ff15572 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:05.819292 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed3d0-4b67-4f97-a42a-5ef51ff15572 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:05.819467 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed3d0-4b67-4f97-a42a-5ef51ff15572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:05.841338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-a85ed3d0-4b67-4f97-a42a-5ef51ff15572 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:41:05.842637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a85ed3d0-4b67-4f97-a42a-5ef51ff15572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:05.898999 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1205/2397] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:41:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:41:05.906955 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3c77-670e-4af4-92db-16034f2f6cfb None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:05.907242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3c77-670e-4af4-92db-16034f2f6cfb None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:05.907567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3c77-670e-4af4-92db-16034f2f6cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:05.925790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-b33b3c77-670e-4af4-92db-16034f2f6cfb None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:41:05.927006 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b33b3c77-670e-4af4-92db-16034f2f6cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:05.935797 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1193/2398] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:41:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:41:05.941657 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ed3d0-4b67-4f97-a42a-5ef51ff15572 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:05.946286 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3c77-670e-4af4-92db-16034f2f6cfb None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:05.948364 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b33b3c77-670e-4af4-92db-16034f2f6cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:05.955002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ed3d0-4b67-4f97-a42a-5ef51ff15572 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:05.957478 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411ac21-abde-47dd-9405-d3b82569ca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:05.958249 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411ac21-abde-47dd-9405-d3b82569ca5d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:05.958533 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411ac21-abde-47dd-9405-d3b82569ca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:05.958808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411ac21-abde-47dd-9405-d3b82569ca5d admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:05.959529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411ac21-abde-47dd-9405-d3b82569ca5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:41:05.959832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411ac21-abde-47dd-9405-d3b82569ca5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:05.961427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411ac21-abde-47dd-9405-d3b82569ca5d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:05.973425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1206/2399] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:41:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:41:05.977938 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411ac21-abde-47dd-9405-d3b82569ca5d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:05.989500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411ac21-abde-47dd-9405-d3b82569ca5d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:05.995269 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe0b46-ee85-4e60-a02b-3a82db871804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:05.996003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe0b46-ee85-4e60-a02b-3a82db871804 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:05.996313 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe0b46-ee85-4e60-a02b-3a82db871804 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:05.996615 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe0b46-ee85-4e60-a02b-3a82db871804 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:05.997296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe0b46-ee85-4e60-a02b-3a82db871804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:05.999354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe0b46-ee85-4e60-a02b-3a82db871804 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:06.028488 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3c77-670e-4af4-92db-16034f2f6cfb None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:06.034420 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b9823-ba4f-4361-9aa8-2622519f2c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:06.035074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b9823-ba4f-4361-9aa8-2622519f2c04 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:06.035357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b9823-ba4f-4361-9aa8-2622519f2c04 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:06.035630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b9823-ba4f-4361-9aa8-2622519f2c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:06.037572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f61b9823-ba4f-4361-9aa8-2622519f2c04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:06.098263 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1207/2400] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:41:05 2021] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:41:06.099501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe0b46-ee85-4e60-a02b-3a82db871804 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:06.099952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b9823-ba4f-4361-9aa8-2622519f2c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:06.101539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b9823-ba4f-4361-9aa8-2622519f2c04 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:06.110936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1194/2401] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:05 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:41:06.161638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe0b46-ee85-4e60-a02b-3a82db871804 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:06.166646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0abc4f-903c-4621-bbe0-3917d2ef9361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:06.167565 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0abc4f-903c-4621-bbe0-3917d2ef9361 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:06.167851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0abc4f-903c-4621-bbe0-3917d2ef9361 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:06.168132 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0abc4f-903c-4621-bbe0-3917d2ef9361 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:06.168809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0abc4f-903c-4621-bbe0-3917d2ef9361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:06.170779 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0abc4f-903c-4621-bbe0-3917d2ef9361 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:06.253955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1208/2402] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:41:06 2021] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:41:06.257679 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b9823-ba4f-4361-9aa8-2622519f2c04 service nova] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:06.268126 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b9823-ba4f-4361-9aa8-2622519f2c04 service nova] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:06.272656 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0fc39-611d-4efe-a32d-d261109e099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:06.273343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0fc39-611d-4efe-a32d-d261109e099b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:06.273654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0fc39-611d-4efe-a32d-d261109e099b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:06.273977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0fc39-611d-4efe-a32d-d261109e099b admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:06.274698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0fc39-611d-4efe-a32d-d261109e099b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:06.276544 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0fc39-611d-4efe-a32d-d261109e099b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:06.288373 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1195/2403] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:41:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:41:06.292513 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0abc4f-903c-4621-bbe0-3917d2ef9361 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:06.302532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0abc4f-903c-4621-bbe0-3917d2ef9361 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:06.307739 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2dff5-4875-49be-94f4-dd6bf9621b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:06.308465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2dff5-4875-49be-94f4-dd6bf9621b44 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:06.308748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2dff5-4875-49be-94f4-dd6bf9621b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:06.309020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2dff5-4875-49be-94f4-dd6bf9621b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:06.309739 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2dff5-4875-49be-94f4-dd6bf9621b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:06.311359 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2dff5-4875-49be-94f4-dd6bf9621b44 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:06.320928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1209/2404] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:41:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:41:06.324971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0fc39-611d-4efe-a32d-d261109e099b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:06.334551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0fc39-611d-4efe-a32d-d261109e099b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:06.339231 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e68e72-c015-42b7-91f0-0ffadbd7943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:06.340099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e68e72-c015-42b7-91f0-0ffadbd7943c admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:06.340380 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e68e72-c015-42b7-91f0-0ffadbd7943c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:06.340755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e68e72-c015-42b7-91f0-0ffadbd7943c admin admin] PATH_INFO: `/v3/projects/7598c4a3c09c45ecb083567cdba2b689/users/9a21c6fafbac4a22a8ca29b3c98332d3/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:06.357778 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e68e72-c015-42b7-91f0-0ffadbd7943c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7598c4a3c09c45ecb083567cdba2b689, user_id=9a21c6fafbac4a22a8ca29b3c98332d3, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:06.360353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e68e72-c015-42b7-91f0-0ffadbd7943c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:06.457311 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1196/2405] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:41:06 2021] PUT /identity/v3/projects/7598c4a3c09c45ecb083567cdba2b689/users/9a21c6fafbac4a22a8ca29b3c98332d3/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:41:06.468851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02374d7-ba98-478e-a8f4-6aa62f7cfd42 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:06.469167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02374d7-ba98-478e-a8f4-6aa62f7cfd42 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:06.472366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02374d7-ba98-478e-a8f4-6aa62f7cfd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:06.498016 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c02374d7-ba98-478e-a8f4-6aa62f7cfd42 None None] MFA Rules not processed for user `9a21c6fafbac4a22a8ca29b3c98332d3`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:41:06.499440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c02374d7-ba98-478e-a8f4-6aa62f7cfd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:06.562178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1210/2406] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:41:06 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:41:06.566616 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e68e72-c015-42b7-91f0-0ffadbd7943c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:06.638507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e68e72-c015-42b7-91f0-0ffadbd7943c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:06.643190 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510d17e-72c2-4fab-a706-8df5af723784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:06.643952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510d17e-72c2-4fab-a706-8df5af723784 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:06.644235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510d17e-72c2-4fab-a706-8df5af723784 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:06.644517 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510d17e-72c2-4fab-a706-8df5af723784 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:06.645241 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510d17e-72c2-4fab-a706-8df5af723784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:06.647143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510d17e-72c2-4fab-a706-8df5af723784 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:07.112965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1197/2407] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:41:06 2021] POST /identity/v3/projects => generated 381 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:41:07.117000 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02374d7-ba98-478e-a8f4-6aa62f7cfd42 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:07.128421 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02374d7-ba98-478e-a8f4-6aa62f7cfd42 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:07.181688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0d415-6c8d-4bef-a0c5-eaa28e073645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:07.183156 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0d415-6c8d-4bef-a0c5-eaa28e073645 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:07.183485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0d415-6c8d-4bef-a0c5-eaa28e073645 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:07.183771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0d415-6c8d-4bef-a0c5-eaa28e073645 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:07.184866 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0d415-6c8d-4bef-a0c5-eaa28e073645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:07.187113 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0d415-6c8d-4bef-a0c5-eaa28e073645 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:07.346210 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1211/2408] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:41:07 2021] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:41:07.347737 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510d17e-72c2-4fab-a706-8df5af723784 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:07.359135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510d17e-72c2-4fab-a706-8df5af723784 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:07.363828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6a098-5540-4aa2-9a46-8ce75fbfdcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:07.364495 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6a098-5540-4aa2-9a46-8ce75fbfdcad admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:07.364777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6a098-5540-4aa2-9a46-8ce75fbfdcad admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:07.365050 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6a098-5540-4aa2-9a46-8ce75fbfdcad admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:07.365780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6a098-5540-4aa2-9a46-8ce75fbfdcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:07.367509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6a098-5540-4aa2-9a46-8ce75fbfdcad admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:07.379952 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1198/2409] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:41:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:41:07.385227 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0d415-6c8d-4bef-a0c5-eaa28e073645 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:07.395446 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0d415-6c8d-4bef-a0c5-eaa28e073645 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:07.400396 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46b028-7951-48ad-b664-16783f9a58ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:07.401988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46b028-7951-48ad-b664-16783f9a58ff admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:07.402406 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46b028-7951-48ad-b664-16783f9a58ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:07.402813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46b028-7951-48ad-b664-16783f9a58ff admin admin] PATH_INFO: `/v3/projects/a78e9e709a8645b3a1df87fc0b79594c/users/ce1221d01c7e40cf86a5bc80a89c849e/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:07.420375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46b028-7951-48ad-b664-16783f9a58ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78e9e709a8645b3a1df87fc0b79594c, user_id=ce1221d01c7e40cf86a5bc80a89c849e, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:07.423113 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46b028-7951-48ad-b664-16783f9a58ff admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:07.493800 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1212/2410] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:41:07 2021] PUT /identity/v3/projects/a78e9e709a8645b3a1df87fc0b79594c/users/ce1221d01c7e40cf86a5bc80a89c849e/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:41:07.498123 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6a098-5540-4aa2-9a46-8ce75fbfdcad admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:07.508999 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6a098-5540-4aa2-9a46-8ce75fbfdcad admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:07.565036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc268f-2dda-474d-b8d9-8d8fcd7fc5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:07.565551 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc268f-2dda-474d-b8d9-8d8fcd7fc5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:07.565747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc268f-2dda-474d-b8d9-8d8fcd7fc5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:07.566112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc268f-2dda-474d-b8d9-8d8fcd7fc5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:07.566817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc268f-2dda-474d-b8d9-8d8fcd7fc5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:07.568430 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc268f-2dda-474d-b8d9-8d8fcd7fc5d5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:07.578693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1199/2411] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:41:07 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:41:07.582784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46b028-7951-48ad-b664-16783f9a58ff admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:07.593487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46b028-7951-48ad-b664-16783f9a58ff admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:07.598046 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84754ea-0402-48a4-a8b3-83e8b58b84db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:07.598905 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84754ea-0402-48a4-a8b3-83e8b58b84db admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:07.599427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84754ea-0402-48a4-a8b3-83e8b58b84db admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:07.599701 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84754ea-0402-48a4-a8b3-83e8b58b84db admin admin] PATH_INFO: `/v3/projects/a78e9e709a8645b3a1df87fc0b79594c/users/ce1221d01c7e40cf86a5bc80a89c849e/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:07.601624 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84754ea-0402-48a4-a8b3-83e8b58b84db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78e9e709a8645b3a1df87fc0b79594c, user_id=ce1221d01c7e40cf86a5bc80a89c849e, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:07.604972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84754ea-0402-48a4-a8b3-83e8b58b84db admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:07.614705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1213/2412] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:41:07 2021] PUT /identity/v3/projects/a78e9e709a8645b3a1df87fc0b79594c/users/ce1221d01c7e40cf86a5bc80a89c849e/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:41:07.624481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010308c-6dc2-41d5-bfd4-665c5918104a None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:07.624776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010308c-6dc2-41d5-bfd4-665c5918104a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:07.625061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010308c-6dc2-41d5-bfd4-665c5918104a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:07.652007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e010308c-6dc2-41d5-bfd4-665c5918104a None None] MFA Rules not processed for user `ce1221d01c7e40cf86a5bc80a89c849e`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:41:07.653229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e010308c-6dc2-41d5-bfd4-665c5918104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:07.720421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1200/2413] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:41:07 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:41:07.731452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84754ea-0402-48a4-a8b3-83e8b58b84db admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:07.733178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f84754ea-0402-48a4-a8b3-83e8b58b84db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:07.788399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84754ea-0402-48a4-a8b3-83e8b58b84db admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:07.792529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d12291-3c61-4ede-8667-f0d1fa4cd632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:07.793207 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d12291-3c61-4ede-8667-f0d1fa4cd632 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:07.793452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d12291-3c61-4ede-8667-f0d1fa4cd632 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:07.793725 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d12291-3c61-4ede-8667-f0d1fa4cd632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:07.803091 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d12291-3c61-4ede-8667-f0d1fa4cd632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:07.804447 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d12291-3c61-4ede-8667-f0d1fa4cd632 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:07.816534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1214/2414] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:07 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:41:07.931990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010308c-6dc2-41d5-bfd4-665c5918104a None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:07.933419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e010308c-6dc2-41d5-bfd4-665c5918104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:07.945724 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010308c-6dc2-41d5-bfd4-665c5918104a None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:07.951556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5c2ac-017b-4409-967f-b2a5bb1037ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:07.951556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5c2ac-017b-4409-967f-b2a5bb1037ce service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:07.951556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5c2ac-017b-4409-967f-b2a5bb1037ce service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:07.951556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5c2ac-017b-4409-967f-b2a5bb1037ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:08.015143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5c2ac-017b-4409-967f-b2a5bb1037ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:08.016611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5c2ac-017b-4409-967f-b2a5bb1037ce service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:08.026172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1201/2415] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:07 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:41:08.232029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d12291-3c61-4ede-8667-f0d1fa4cd632 service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:08.293211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d12291-3c61-4ede-8667-f0d1fa4cd632 service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:08.297814 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:08.298718 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:08.298995 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:08.299265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] PATH_INFO: `/v3/users/9a21c6fafbac4a22a8ca29b3c98332d3` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:08.300443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a21c6fafbac4a22a8ca29b3c98332d3)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:08.302377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:08.518635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a21c6fafbac4a22a8ca29b3c98332d3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:08.519283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a21c6fafbac4a22a8ca29b3c98332d3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:08.519900 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a21c6fafbac4a22a8ca29b3c98332d3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:08.579101 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a21c6fafbac4a22a8ca29b3c98332d3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:08.607008 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a21c6fafbac4a22a8ca29b3c98332d3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:08.619112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1215/2416] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:41:08 2021] DELETE /identity/v3/users/9a21c6fafbac4a22a8ca29b3c98332d3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:41:08.624452 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0f3b2-8da8-4361-8c8a-ad63aab806d3 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:08.625305 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0f3b2-8da8-4361-8c8a-ad63aab806d3 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:08.625589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0f3b2-8da8-4361-8c8a-ad63aab806d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:08.642988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f9d0f3b2-8da8-4361-8c8a-ad63aab806d3 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:41:08.653921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f9d0f3b2-8da8-4361-8c8a-ad63aab806d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:08.702051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1202/2417] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:41:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:41:08.712236 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:08.713694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:08.773484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0e310-fc3d-4bd3-801e-3b731e14476e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:08.777404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ba0e1-c409-4b72-9729-114401e0d82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:08.783448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ba0e1-c409-4b72-9729-114401e0d82d service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:08.783448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ba0e1-c409-4b72-9729-114401e0d82d service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:08.783448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ba0e1-c409-4b72-9729-114401e0d82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:08.787485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ba0e1-c409-4b72-9729-114401e0d82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:08.788916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ba0e1-c409-4b72-9729-114401e0d82d service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:08.798636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1216/2418] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:41:08.912802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0f3b2-8da8-4361-8c8a-ad63aab806d3 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:08.914221 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f9d0f3b2-8da8-4361-8c8a-ad63aab806d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:08.985415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0f3b2-8da8-4361-8c8a-ad63aab806d3 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:08.991592 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1a4be-12a5-4820-b643-1c7e1346babe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:08.991932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1a4be-12a5-4820-b643-1c7e1346babe service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:08.992212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1a4be-12a5-4820-b643-1c7e1346babe service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:08.992483 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1a4be-12a5-4820-b643-1c7e1346babe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:08.994269 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ccc1a4be-12a5-4820-b643-1c7e1346babe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:09.058502 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1a4be-12a5-4820-b643-1c7e1346babe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:09.060093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1a4be-12a5-4820-b643-1c7e1346babe service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:09.068950 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1203/2419] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:08 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:41:09.224544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ba0e1-c409-4b72-9729-114401e0d82d service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:09.225978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-183ba0e1-c409-4b72-9729-114401e0d82d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:09.239577 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ba0e1-c409-4b72-9729-114401e0d82d service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:09.244167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:09.245827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:09.246136 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:09.246430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] PATH_INFO: `/v3/projects/7598c4a3c09c45ecb083567cdba2b689` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:09.247628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7598c4a3c09c45ecb083567cdba2b689)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:09.249499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:09.371753 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7598c4a3c09c45ecb083567cdba2b689', 'request_id': 'req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:09.441776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7598c4a3c09c45ecb083567cdba2b689', 'request_id': 'req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:09.448571 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7598c4a3c09c45ecb083567cdba2b689', 'request_id': 'req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:09.459499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] The token cache is being invalidate because project 7598c4a3c09c45ecb083567cdba2b689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:41:09.459791 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:09.460412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:09.461987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1217/2420] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:41:09 2021] DELETE /identity/v3/projects/7598c4a3c09c45ecb083567cdba2b689 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:41:09.466688 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1a4be-12a5-4820-b643-1c7e1346babe service nova] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:09.476963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1a4be-12a5-4820-b643-1c7e1346babe service nova] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:09.531506 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26495dae-a150-462c-827e-0fc258cbefa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:09.532361 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26495dae-a150-462c-827e-0fc258cbefa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:09.532638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26495dae-a150-462c-827e-0fc258cbefa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:09.532908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26495dae-a150-462c-827e-0fc258cbefa7 admin admin] PATH_INFO: `/v3/users/ce1221d01c7e40cf86a5bc80a89c849e` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:09.534154 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26495dae-a150-462c-827e-0fc258cbefa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1221d01c7e40cf86a5bc80a89c849e)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:09.536045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26495dae-a150-462c-827e-0fc258cbefa7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:09.740916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-26495dae-a150-462c-827e-0fc258cbefa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1221d01c7e40cf86a5bc80a89c849e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:09.741554 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-26495dae-a150-462c-827e-0fc258cbefa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1221d01c7e40cf86a5bc80a89c849e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:09.748869 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-26495dae-a150-462c-827e-0fc258cbefa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1221d01c7e40cf86a5bc80a89c849e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:09.805481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-26495dae-a150-462c-827e-0fc258cbefa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1221d01c7e40cf86a5bc80a89c849e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:09.817820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-26495dae-a150-462c-827e-0fc258cbefa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1221d01c7e40cf86a5bc80a89c849e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:09.824193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1204/2421] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:41:09 2021] DELETE /identity/v3/users/ce1221d01c7e40cf86a5bc80a89c849e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:41:10.266421 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:10.268132 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:10.284301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480561c-7fa4-4e7a-ab3f-893ec0fba2e1 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:10.348317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:10.349429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:10.349716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:10.350031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec admin admin] PATH_INFO: `/v3/projects/a78e9e709a8645b3a1df87fc0b79594c` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:10.351208 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78e9e709a8645b3a1df87fc0b79594c)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:10.353209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:10.457996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78e9e709a8645b3a1df87fc0b79594c', 'request_id': 'req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:10.556377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78e9e709a8645b3a1df87fc0b79594c', 'request_id': 'req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:10.562640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78e9e709a8645b3a1df87fc0b79594c', 'request_id': 'req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:10.574077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec admin admin] The token cache is being invalidate because project a78e9e709a8645b3a1df87fc0b79594c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:41:10.574355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:10.574973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ac9bad86-9e34-4545-ab2c-9f1ba4464dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:41:10.576504 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1218/2422] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:41:10 2021] DELETE /identity/v3/projects/a78e9e709a8645b3a1df87fc0b79594c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:41:10.583758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd793607-b8d7-4233-aed9-4ab18ead4530 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:10.584076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd793607-b8d7-4233-aed9-4ab18ead4530 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:10.584353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd793607-b8d7-4233-aed9-4ab18ead4530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:10.604998 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-fd793607-b8d7-4233-aed9-4ab18ead4530 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:41:10.606322 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-fd793607-b8d7-4233-aed9-4ab18ead4530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:10.665271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1205/2423] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:41:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:41:10.673971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c170c0-c82e-4559-aa9a-eee2be9136ff None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:10.674269 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c170c0-c82e-4559-aa9a-eee2be9136ff None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:10.674547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c170c0-c82e-4559-aa9a-eee2be9136ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:10.693190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b4c170c0-c82e-4559-aa9a-eee2be9136ff None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:41:10.694441 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b4c170c0-c82e-4559-aa9a-eee2be9136ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:10.703634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1219/2424] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:41:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:41:10.708050 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd793607-b8d7-4233-aed9-4ab18ead4530 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:10.717834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd793607-b8d7-4233-aed9-4ab18ead4530 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:10.722480 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db3bb0-ca6d-4976-ad1c-460d10e25c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:10.723129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db3bb0-ca6d-4976-ad1c-460d10e25c43 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:10.723411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db3bb0-ca6d-4976-ad1c-460d10e25c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:10.723686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db3bb0-ca6d-4976-ad1c-460d10e25c43 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:10.724663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db3bb0-ca6d-4976-ad1c-460d10e25c43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:41:10.724971 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db3bb0-ca6d-4976-ad1c-460d10e25c43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:10.726587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db3bb0-ca6d-4976-ad1c-460d10e25c43 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:10.738082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1206/2425] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:41:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:41:10.742198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c170c0-c82e-4559-aa9a-eee2be9136ff None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:10.752333 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c170c0-c82e-4559-aa9a-eee2be9136ff None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:10.757074 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d223104-4ff8-4ea0-b713-33893014a2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:10.757731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d223104-4ff8-4ea0-b713-33893014a2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:10.758055 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d223104-4ff8-4ea0-b713-33893014a2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:10.758331 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d223104-4ff8-4ea0-b713-33893014a2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:10.759012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d223104-4ff8-4ea0-b713-33893014a2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:10.761485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d223104-4ff8-4ea0-b713-33893014a2f9 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:10.845378 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1220/2426] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:41:10 2021] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:41:10.847484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db3bb0-ca6d-4976-ad1c-460d10e25c43 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:10.858980 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db3bb0-ca6d-4976-ad1c-460d10e25c43 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:10.913164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb5dbf-1356-4d75-917a-6e3fceaebf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:10.913835 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb5dbf-1356-4d75-917a-6e3fceaebf1d admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:10.914152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb5dbf-1356-4d75-917a-6e3fceaebf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:10.914426 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb5dbf-1356-4d75-917a-6e3fceaebf1d admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:10.915138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb5dbf-1356-4d75-917a-6e3fceaebf1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:10.917776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb5dbf-1356-4d75-917a-6e3fceaebf1d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:11.013770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1207/2427] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:41:10 2021] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:41:11.019873 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d223104-4ff8-4ea0-b713-33893014a2f9 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:11.030308 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d223104-4ff8-4ea0-b713-33893014a2f9 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:11.034986 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3c7e6-a495-465a-897a-1e6a79390665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:11.035643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3c7e6-a495-465a-897a-1e6a79390665 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:11.035926 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3c7e6-a495-465a-897a-1e6a79390665 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:11.036204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3c7e6-a495-465a-897a-1e6a79390665 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:11.036950 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3c7e6-a495-465a-897a-1e6a79390665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:11.038577 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3c7e6-a495-465a-897a-1e6a79390665 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:11.049506 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1221/2428] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:41:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:41:11.059998 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb5dbf-1356-4d75-917a-6e3fceaebf1d admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:11.069791 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb5dbf-1356-4d75-917a-6e3fceaebf1d admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:11.074578 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bb9b3-3288-4535-acb7-4cbb72f291b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:11.075219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bb9b3-3288-4535-acb7-4cbb72f291b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:11.075502 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bb9b3-3288-4535-acb7-4cbb72f291b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:11.075776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bb9b3-3288-4535-acb7-4cbb72f291b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:11.076488 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bb9b3-3288-4535-acb7-4cbb72f291b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:11.078089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bb9b3-3288-4535-acb7-4cbb72f291b2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:11.087579 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1208/2429] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:41:11 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:41:11.092185 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3c7e6-a495-465a-897a-1e6a79390665 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:11.102190 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3c7e6-a495-465a-897a-1e6a79390665 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:11.107459 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e4239-918e-4e0d-9493-4853049ede04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:11.108318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4239-918e-4e0d-9493-4853049ede04 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:11.108595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4239-918e-4e0d-9493-4853049ede04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:11.108863 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4239-918e-4e0d-9493-4853049ede04 admin admin] PATH_INFO: `/v3/projects/df929356694e48849639f0d3461b5330/users/1bf65b4876df402a920a3eec8b4bb26c/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:11.122729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e4239-918e-4e0d-9493-4853049ede04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df929356694e48849639f0d3461b5330, user_id=1bf65b4876df402a920a3eec8b4bb26c, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:11.125368 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e4239-918e-4e0d-9493-4853049ede04 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:11.189921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1222/2430] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:41:11 2021] PUT /identity/v3/projects/df929356694e48849639f0d3461b5330/users/1bf65b4876df402a920a3eec8b4bb26c/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:41:11.195308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff9c81-6073-4002-83e3-7bb134f87f22 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:11.195619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff9c81-6073-4002-83e3-7bb134f87f22 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:11.195897 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff9c81-6073-4002-83e3-7bb134f87f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:11.214157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-50ff9c81-6073-4002-83e3-7bb134f87f22 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:41:11.215339 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-50ff9c81-6073-4002-83e3-7bb134f87f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:11.277074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1209/2431] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:41:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:41:11.287135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e4239-918e-4e0d-9493-4853049ede04 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:11.288921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-241e4239-918e-4e0d-9493-4853049ede04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:11.348642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e4239-918e-4e0d-9493-4853049ede04 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:11.352633 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6d68b-da47-4c7f-8afe-50d5e8954b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:11.353224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6d68b-da47-4c7f-8afe-50d5e8954b8f service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:11.353509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6d68b-da47-4c7f-8afe-50d5e8954b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:11.353787 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6d68b-da47-4c7f-8afe-50d5e8954b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:11.364636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6d68b-da47-4c7f-8afe-50d5e8954b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:11.366127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6d68b-da47-4c7f-8afe-50d5e8954b8f service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:11.375555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1223/2432] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:41:12.784837 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bac686-2dc2-4984-b79d-1696db9e11bf None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:12.785379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bac686-2dc2-4984-b79d-1696db9e11bf None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:12.785607 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bac686-2dc2-4984-b79d-1696db9e11bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:12.824498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-18bac686-2dc2-4984-b79d-1696db9e11bf None None] MFA Rules not processed for user `1bf65b4876df402a920a3eec8b4bb26c`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:41:12.827915 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-18bac686-2dc2-4984-b79d-1696db9e11bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:12.895679 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1210/2433] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:41:12 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:41:12.906427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6d68b-da47-4c7f-8afe-50d5e8954b8f service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:12.910385 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-24f6d68b-da47-4c7f-8afe-50d5e8954b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:12.970028 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6d68b-da47-4c7f-8afe-50d5e8954b8f service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:12.973638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb219bc1-590b-4da0-987d-fa725aa2955d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:12.974642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219bc1-590b-4da0-987d-fa725aa2955d service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:12.974922 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219bc1-590b-4da0-987d-fa725aa2955d service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:12.975194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219bc1-590b-4da0-987d-fa725aa2955d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:12.983203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb219bc1-590b-4da0-987d-fa725aa2955d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:12.984637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb219bc1-590b-4da0-987d-fa725aa2955d service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:12.993173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1224/2434] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:12 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:41:14.582831 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bac686-2dc2-4984-b79d-1696db9e11bf None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:14.584349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-18bac686-2dc2-4984-b79d-1696db9e11bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:14.596175 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bac686-2dc2-4984-b79d-1696db9e11bf None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:14.600227 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0b3a2-8fa5-4942-bb10-5dc8ed83e606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:14.601066 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0b3a2-8fa5-4942-bb10-5dc8ed83e606 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:14.601413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0b3a2-8fa5-4942-bb10-5dc8ed83e606 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:14.601753 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0b3a2-8fa5-4942-bb10-5dc8ed83e606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:14.603574 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-14f0b3a2-8fa5-4942-bb10-5dc8ed83e606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:14.613845 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0b3a2-8fa5-4942-bb10-5dc8ed83e606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:14.617828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0b3a2-8fa5-4942-bb10-5dc8ed83e606 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:14.624594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1211/2435] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:14 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:41:14.739606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d566f-7ae1-40f2-8ca4-d9b4420db1ca None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:14.740136 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d566f-7ae1-40f2-8ca4-d9b4420db1ca None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:14.740221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d566f-7ae1-40f2-8ca4-d9b4420db1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:14.758542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3d5d566f-7ae1-40f2-8ca4-d9b4420db1ca None None] MFA Rules not processed for user `1bf65b4876df402a920a3eec8b4bb26c`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:41:14.759865 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3d5d566f-7ae1-40f2-8ca4-d9b4420db1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:14.767607 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1225/2436] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:41:14 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:41:15.414412 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0b3a2-8fa5-4942-bb10-5dc8ed83e606 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:15.416416 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-14f0b3a2-8fa5-4942-bb10-5dc8ed83e606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:15.500552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0b3a2-8fa5-4942-bb10-5dc8ed83e606 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:15.506485 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabb610-d694-4aa1-940a-ad4740f8f161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:15.507144 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabb610-d694-4aa1-940a-ad4740f8f161 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:15.507431 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabb610-d694-4aa1-940a-ad4740f8f161 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:15.507698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabb610-d694-4aa1-940a-ad4740f8f161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:15.509519 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5dabb610-d694-4aa1-940a-ad4740f8f161 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:15.522642 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabb610-d694-4aa1-940a-ad4740f8f161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:15.524245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabb610-d694-4aa1-940a-ad4740f8f161 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:15.538085 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1212/2437] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:15 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:41:17.992872 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d566f-7ae1-40f2-8ca4-d9b4420db1ca None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:18.003386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d566f-7ae1-40f2-8ca4-d9b4420db1ca None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:18.015135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f0f45-3383-4f22-969f-fc8788b80820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:18.015135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f0f45-3383-4f22-969f-fc8788b80820 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:18.015135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f0f45-3383-4f22-969f-fc8788b80820 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:18.015135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f0f45-3383-4f22-969f-fc8788b80820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:18.016600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1b1f0f45-3383-4f22-969f-fc8788b80820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:18.028342 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f0f45-3383-4f22-969f-fc8788b80820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:18.030135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f0f45-3383-4f22-969f-fc8788b80820 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:18.040222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1226/2438] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:17 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:41:32.085594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabb610-d694-4aa1-940a-ad4740f8f161 service nova] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:32.097725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabb610-d694-4aa1-940a-ad4740f8f161 service nova] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:32.103573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3e32c-1547-4d80-8cb4-5b79fc3e89d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:32.104208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e32c-1547-4d80-8cb4-5b79fc3e89d5 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:32.104493 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e32c-1547-4d80-8cb4-5b79fc3e89d5 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:32.104767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e32c-1547-4d80-8cb4-5b79fc3e89d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:32.106599 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f8f3e32c-1547-4d80-8cb4-5b79fc3e89d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:32.130176 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3e32c-1547-4d80-8cb4-5b79fc3e89d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:32.130493 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3e32c-1547-4d80-8cb4-5b79fc3e89d5 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:32.142093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1213/2439] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:32 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:41:42.143242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f0f45-3383-4f22-969f-fc8788b80820 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:42.151691 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f0f45-3383-4f22-969f-fc8788b80820 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:42.155797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e441a20-be45-4ff5-86dd-e9cec3c45193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:42.156445 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e441a20-be45-4ff5-86dd-e9cec3c45193 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:42.156729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e441a20-be45-4ff5-86dd-e9cec3c45193 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:42.157012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e441a20-be45-4ff5-86dd-e9cec3c45193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:42.158975 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5e441a20-be45-4ff5-86dd-e9cec3c45193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:42.223416 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e441a20-be45-4ff5-86dd-e9cec3c45193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:42.225161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e441a20-be45-4ff5-86dd-e9cec3c45193 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:42.235981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1227/2440] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:42 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:41:44.082587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b4c4c-ded1-4c41-88e7-d1d6b8d19396 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:44.083118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b4c4c-ded1-4c41-88e7-d1d6b8d19396 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:44.083118 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b4c4c-ded1-4c41-88e7-d1d6b8d19396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:44.102217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-eb1b4c4c-ded1-4c41-88e7-d1d6b8d19396 None None] MFA Rules not processed for user `1bf65b4876df402a920a3eec8b4bb26c`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:41:44.103472 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-eb1b4c4c-ded1-4c41-88e7-d1d6b8d19396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:44.111065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1214/2441] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:41:44 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:41:44.230209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e441a20-be45-4ff5-86dd-e9cec3c45193 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:41:44.232345 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5e441a20-be45-4ff5-86dd-e9cec3c45193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:44.248224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e441a20-be45-4ff5-86dd-e9cec3c45193 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:41:44.253820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b4e3d-7071-4c94-b718-ed6002f06b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:41:44.254682 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b4e3d-7071-4c94-b718-ed6002f06b88 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:41:44.254859 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b4e3d-7071-4c94-b718-ed6002f06b88 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:41:44.255331 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b4e3d-7071-4c94-b718-ed6002f06b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:41:44.257104 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-109b4e3d-7071-4c94-b718-ed6002f06b88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:41:44.269828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b4e3d-7071-4c94-b718-ed6002f06b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:41:44.274690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b4e3d-7071-4c94-b718-ed6002f06b88 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:41:44.283404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1228/2442] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:41:44 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:42:00.713970 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b4c4c-ded1-4c41-88e7-d1d6b8d19396 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:00.715548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-eb1b4c4c-ded1-4c41-88e7-d1d6b8d19396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:00.730264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b4c4c-ded1-4c41-88e7-d1d6b8d19396 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:00.735886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db17e5-e90a-4f1a-837e-a0822dd1799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:00.736698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db17e5-e90a-4f1a-837e-a0822dd1799b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:00.736980 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db17e5-e90a-4f1a-837e-a0822dd1799b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:00.737256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db17e5-e90a-4f1a-837e-a0822dd1799b admin admin] PATH_INFO: `/v3/users/9f616dad20824b21927f4f6a2a9abaad` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:00.738469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db17e5-e90a-4f1a-837e-a0822dd1799b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f616dad20824b21927f4f6a2a9abaad)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:00.740373 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db17e5-e90a-4f1a-837e-a0822dd1799b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:00.917685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b6db17e5-e90a-4f1a-837e-a0822dd1799b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f616dad20824b21927f4f6a2a9abaad'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:00.918360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b6db17e5-e90a-4f1a-837e-a0822dd1799b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f616dad20824b21927f4f6a2a9abaad'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:00.925574 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b6db17e5-e90a-4f1a-837e-a0822dd1799b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f616dad20824b21927f4f6a2a9abaad'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:00.988349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b6db17e5-e90a-4f1a-837e-a0822dd1799b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f616dad20824b21927f4f6a2a9abaad'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:01.002226 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-b6db17e5-e90a-4f1a-837e-a0822dd1799b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f616dad20824b21927f4f6a2a9abaad'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:01.009598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1215/2443] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:42:00 2021] DELETE /identity/v3/users/9f616dad20824b21927f4f6a2a9abaad => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:42:01.249051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b4e3d-7071-4c94-b718-ed6002f06b88 service nova] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:01.260442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b4e3d-7071-4c94-b718-ed6002f06b88 service nova] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:01.317006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:01.317891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:01.318165 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:01.318436 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] PATH_INFO: `/v3/projects/2c3972b7a84b4e868b143f35255ea143` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:01.319579 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3972b7a84b4e868b143f35255ea143)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:01.321458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:01.446918 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3972b7a84b4e868b143f35255ea143', 'request_id': 'req-cd668e9f-c316-42e0-92e1-06f936105ebb'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:01.516114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3972b7a84b4e868b143f35255ea143', 'request_id': 'req-cd668e9f-c316-42e0-92e1-06f936105ebb'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:01.522088 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3972b7a84b4e868b143f35255ea143', 'request_id': 'req-cd668e9f-c316-42e0-92e1-06f936105ebb'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:01.533748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] The token cache is being invalidate because project 2c3972b7a84b4e868b143f35255ea143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:42:01.534082 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:01.534744 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:01.536301 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1229/2444] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:42:01 2021] DELETE /identity/v3/projects/2c3972b7a84b4e868b143f35255ea143 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:42:09.464933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd66b-01c2-4ec4-b163-f6f590429b16 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:09.465453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd66b-01c2-4ec4-b163-f6f590429b16 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:09.465570 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd66b-01c2-4ec4-b163-f6f590429b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:09.485819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c15dd66b-01c2-4ec4-b163-f6f590429b16 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:42:09.487038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c15dd66b-01c2-4ec4-b163-f6f590429b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:09.541825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1216/2445] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:42:09 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:42:09.704487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:09.706544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:09.776307 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd668e9f-c316-42e0-92e1-06f936105ebb admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:09.782591 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9950ad-11ec-46cf-9edc-80363f647590 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:09.783238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9950ad-11ec-46cf-9edc-80363f647590 service swift] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:09.783530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9950ad-11ec-46cf-9edc-80363f647590 service swift] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:09.783808 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9950ad-11ec-46cf-9edc-80363f647590 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:09.791876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9950ad-11ec-46cf-9edc-80363f647590 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:09.793457 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9950ad-11ec-46cf-9edc-80363f647590 service swift] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:09.801798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1230/2446] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:42:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 14:42:12.706543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c7ced-75f7-4541-87f4-aee92faf18b3 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:12.707115 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c7ced-75f7-4541-87f4-aee92faf18b3 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:12.707347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c7ced-75f7-4541-87f4-aee92faf18b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:12.731403 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-818c7ced-75f7-4541-87f4-aee92faf18b3 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:42:12.733392 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-818c7ced-75f7-4541-87f4-aee92faf18b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:12.741174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1217/2447] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:42:12 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:42:12.759986 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9950ad-11ec-46cf-9edc-80363f647590 service swift] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:12.784149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9950ad-11ec-46cf-9edc-80363f647590 service swift] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:12.789788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d718ed-0518-4855-b4f5-1eb993fd907a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:12.790583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d718ed-0518-4855-b4f5-1eb993fd907a service swift] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:12.790931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d718ed-0518-4855-b4f5-1eb993fd907a service swift] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:12.791271 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d718ed-0518-4855-b4f5-1eb993fd907a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:12.806544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d718ed-0518-4855-b4f5-1eb993fd907a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:12.812805 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d718ed-0518-4855-b4f5-1eb993fd907a service swift] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:12.821825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1231/2448] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:42:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 14:42:29.250032 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8b212-65ed-4c03-9f0d-89da8c74cc12 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:29.252978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8b212-65ed-4c03-9f0d-89da8c74cc12 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:29.252978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8b212-65ed-4c03-9f0d-89da8c74cc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:29.272686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-b1a8b212-65ed-4c03-9f0d-89da8c74cc12 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:42:29.273951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b1a8b212-65ed-4c03-9f0d-89da8c74cc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:29.281536 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1218/2449] 10.222.0.16 () {58 vars in 968 bytes} [Sun Aug 29 14:42:29 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:42:29.294047 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d718ed-0518-4855-b4f5-1eb993fd907a service swift] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:29.304478 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d718ed-0518-4855-b4f5-1eb993fd907a service swift] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:29.309474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a2f61-b7ee-4ce2-a7d7-38f6c2d85770 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:29.310689 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a2f61-b7ee-4ce2-a7d7-38f6c2d85770 service swift] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:29.310970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a2f61-b7ee-4ce2-a7d7-38f6c2d85770 service swift] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:29.311373 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a2f61-b7ee-4ce2-a7d7-38f6c2d85770 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:29.319188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a2f61-b7ee-4ce2-a7d7-38f6c2d85770 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:29.327483 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a2f61-b7ee-4ce2-a7d7-38f6c2d85770 service swift] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:29.329621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1232/2450] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:42:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 14:42:32.664711 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8b212-65ed-4c03-9f0d-89da8c74cc12 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:32.666557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b1a8b212-65ed-4c03-9f0d-89da8c74cc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:32.735646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8b212-65ed-4c03-9f0d-89da8c74cc12 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:32.740157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae3e82-2d90-4aa5-95a0-cc59bd46b82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:32.741017 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae3e82-2d90-4aa5-95a0-cc59bd46b82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:32.741289 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae3e82-2d90-4aa5-95a0-cc59bd46b82d admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:32.741552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae3e82-2d90-4aa5-95a0-cc59bd46b82d admin admin] PATH_INFO: `/v3/users/1bf65b4876df402a920a3eec8b4bb26c` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:32.742773 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae3e82-2d90-4aa5-95a0-cc59bd46b82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf65b4876df402a920a3eec8b4bb26c)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:32.744660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae3e82-2d90-4aa5-95a0-cc59bd46b82d admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:32.947984 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-a0ae3e82-2d90-4aa5-95a0-cc59bd46b82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf65b4876df402a920a3eec8b4bb26c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:32.948643 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-a0ae3e82-2d90-4aa5-95a0-cc59bd46b82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf65b4876df402a920a3eec8b4bb26c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:32.958570 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-a0ae3e82-2d90-4aa5-95a0-cc59bd46b82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf65b4876df402a920a3eec8b4bb26c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:33.018634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-a0ae3e82-2d90-4aa5-95a0-cc59bd46b82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf65b4876df402a920a3eec8b4bb26c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:33.030796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-a0ae3e82-2d90-4aa5-95a0-cc59bd46b82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf65b4876df402a920a3eec8b4bb26c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:33.036447 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1219/2451] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:42:32 2021] DELETE /identity/v3/users/1bf65b4876df402a920a3eec8b4bb26c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:42:33.301557 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a2f61-b7ee-4ce2-a7d7-38f6c2d85770 service swift] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:33.314346 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a2f61-b7ee-4ce2-a7d7-38f6c2d85770 service swift] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:33.377968 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a257af-578f-44fe-b049-225305216f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:33.378828 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a257af-578f-44fe-b049-225305216f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:33.379171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a257af-578f-44fe-b049-225305216f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:33.379452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a257af-578f-44fe-b049-225305216f60 admin admin] PATH_INFO: `/v3/projects/df929356694e48849639f0d3461b5330` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:33.380636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a257af-578f-44fe-b049-225305216f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df929356694e48849639f0d3461b5330)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:33.382549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a257af-578f-44fe-b049-225305216f60 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:33.508585 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-40a257af-578f-44fe-b049-225305216f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df929356694e48849639f0d3461b5330', 'request_id': 'req-40a257af-578f-44fe-b049-225305216f60'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:33.601417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-40a257af-578f-44fe-b049-225305216f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df929356694e48849639f0d3461b5330', 'request_id': 'req-40a257af-578f-44fe-b049-225305216f60'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:33.607539 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-40a257af-578f-44fe-b049-225305216f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df929356694e48849639f0d3461b5330', 'request_id': 'req-40a257af-578f-44fe-b049-225305216f60'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:33.618710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-40a257af-578f-44fe-b049-225305216f60 admin admin] The token cache is being invalidate because project df929356694e48849639f0d3461b5330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:42:33.619005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-40a257af-578f-44fe-b049-225305216f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:33.619638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-40a257af-578f-44fe-b049-225305216f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:42:33.621180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1233/2452] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:42:33 2021] DELETE /identity/v3/projects/df929356694e48849639f0d3461b5330 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:42:33.629656 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0a08e-902b-4df8-9889-9387542664a3 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:33.629980 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0a08e-902b-4df8-9889-9387542664a3 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:33.630372 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0a08e-902b-4df8-9889-9387542664a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:33.650883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-bbd0a08e-902b-4df8-9889-9387542664a3 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:42:33.652090 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-bbd0a08e-902b-4df8-9889-9387542664a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:33.711812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1220/2453] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:42:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:42:33.719894 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435f319-6b03-44a5-8551-d5bfa471adc8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:33.726811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435f319-6b03-44a5-8551-d5bfa471adc8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:33.726811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435f319-6b03-44a5-8551-d5bfa471adc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:33.739215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-0435f319-6b03-44a5-8551-d5bfa471adc8 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:42:33.740427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-0435f319-6b03-44a5-8551-d5bfa471adc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:33.748990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1234/2454] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:42:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:42:33.753395 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0a08e-902b-4df8-9889-9387542664a3 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:33.762777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0a08e-902b-4df8-9889-9387542664a3 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:33.768072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ca723-2c33-4b7d-a201-311c02ec55f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:33.768709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca723-2c33-4b7d-a201-311c02ec55f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:33.768991 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca723-2c33-4b7d-a201-311c02ec55f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:33.769262 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca723-2c33-4b7d-a201-311c02ec55f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:33.769996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ca723-2c33-4b7d-a201-311c02ec55f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:42:33.770298 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ca723-2c33-4b7d-a201-311c02ec55f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:33.771853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ca723-2c33-4b7d-a201-311c02ec55f4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:33.782951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1221/2455] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:42:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:42:33.787263 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435f319-6b03-44a5-8551-d5bfa471adc8 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:33.799455 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435f319-6b03-44a5-8551-d5bfa471adc8 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:33.806001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdfe01-8dbe-41b5-b27d-18d463745131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:33.806838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdfe01-8dbe-41b5-b27d-18d463745131 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:33.807118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdfe01-8dbe-41b5-b27d-18d463745131 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:33.807389 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdfe01-8dbe-41b5-b27d-18d463745131 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:33.808124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdfe01-8dbe-41b5-b27d-18d463745131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:33.810791 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdfe01-8dbe-41b5-b27d-18d463745131 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:33.912161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1235/2456] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:42:33 2021] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:42:33.918626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ca723-2c33-4b7d-a201-311c02ec55f4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:33.929049 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ca723-2c33-4b7d-a201-311c02ec55f4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:33.984867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b32ad7-e74a-465f-afd6-d9c3ee070647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:33.985534 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b32ad7-e74a-465f-afd6-d9c3ee070647 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:33.985809 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b32ad7-e74a-465f-afd6-d9c3ee070647 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:33.986113 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b32ad7-e74a-465f-afd6-d9c3ee070647 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:33.986802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b32ad7-e74a-465f-afd6-d9c3ee070647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:33.988674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b32ad7-e74a-465f-afd6-d9c3ee070647 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:34.093616 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1222/2457] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:42:33 2021] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:42:34.097638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdfe01-8dbe-41b5-b27d-18d463745131 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:34.110177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdfe01-8dbe-41b5-b27d-18d463745131 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:34.115167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f38b-e929-4b1d-a692-2a12ed616194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:34.115832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f38b-e929-4b1d-a692-2a12ed616194 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:34.116118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f38b-e929-4b1d-a692-2a12ed616194 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:34.116392 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f38b-e929-4b1d-a692-2a12ed616194 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:34.117114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4f38b-e929-4b1d-a692-2a12ed616194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:34.118751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4f38b-e929-4b1d-a692-2a12ed616194 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:34.130245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1236/2458] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:42:34 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:42:34.134273 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b32ad7-e74a-465f-afd6-d9c3ee070647 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:34.145563 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b32ad7-e74a-465f-afd6-d9c3ee070647 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:34.150920 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56917e33-fe86-4ec3-b754-49b42121d01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:34.151490 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56917e33-fe86-4ec3-b754-49b42121d01a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:34.151766 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56917e33-fe86-4ec3-b754-49b42121d01a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:34.152034 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56917e33-fe86-4ec3-b754-49b42121d01a admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:34.152756 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56917e33-fe86-4ec3-b754-49b42121d01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:34.154510 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56917e33-fe86-4ec3-b754-49b42121d01a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:34.165030 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1223/2459] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:42:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:42:34.170009 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f38b-e929-4b1d-a692-2a12ed616194 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:34.180592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f38b-e929-4b1d-a692-2a12ed616194 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:34.186255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaffa10-14ca-48fd-84ce-ccf58bd5997b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:34.187131 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaffa10-14ca-48fd-84ce-ccf58bd5997b admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:34.187417 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaffa10-14ca-48fd-84ce-ccf58bd5997b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:34.187692 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaffa10-14ca-48fd-84ce-ccf58bd5997b admin admin] PATH_INFO: `/v3/projects/50e1e30ed1d34a3095da54288e159f79/users/c1a6ff2d8f214df9810da0000bfe9e79/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:34.202408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaffa10-14ca-48fd-84ce-ccf58bd5997b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e1e30ed1d34a3095da54288e159f79, user_id=c1a6ff2d8f214df9810da0000bfe9e79, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:34.205047 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaffa10-14ca-48fd-84ce-ccf58bd5997b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:34.305049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1237/2460] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:42:34 2021] PUT /identity/v3/projects/50e1e30ed1d34a3095da54288e159f79/users/c1a6ff2d8f214df9810da0000bfe9e79/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:42:34.313154 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d59ae-e140-4344-b024-169599d8b094 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:34.313527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d59ae-e140-4344-b024-169599d8b094 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:34.313885 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d59ae-e140-4344-b024-169599d8b094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:34.331715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-d66d59ae-e140-4344-b024-169599d8b094 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:42:34.332910 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d66d59ae-e140-4344-b024-169599d8b094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:34.391471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1224/2461] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:42:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:42:34.401102 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaffa10-14ca-48fd-84ce-ccf58bd5997b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:34.402951 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-aeaffa10-14ca-48fd-84ce-ccf58bd5997b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:34.458099 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaffa10-14ca-48fd-84ce-ccf58bd5997b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:34.461755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5dae9-747a-4d44-820d-cc2d526308f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:34.462425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5dae9-747a-4d44-820d-cc2d526308f0 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:34.462705 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5dae9-747a-4d44-820d-cc2d526308f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:34.462972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5dae9-747a-4d44-820d-cc2d526308f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:34.472078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5dae9-747a-4d44-820d-cc2d526308f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:34.473499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5dae9-747a-4d44-820d-cc2d526308f0 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:34.483721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1238/2462] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:42:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:42:36.129473 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81949d-526b-40ad-aa53-0679ff357735 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:36.129967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81949d-526b-40ad-aa53-0679ff357735 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:36.133129 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81949d-526b-40ad-aa53-0679ff357735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:36.147863 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-8e81949d-526b-40ad-aa53-0679ff357735 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:42:36.149054 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8e81949d-526b-40ad-aa53-0679ff357735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:36.203309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1225/2463] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:42:36 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:42:36.215944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5dae9-747a-4d44-820d-cc2d526308f0 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:36.218551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-31e5dae9-747a-4d44-820d-cc2d526308f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:36.288863 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5dae9-747a-4d44-820d-cc2d526308f0 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:36.293731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddf01c-2f0a-4a0f-9512-1e25021804c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:36.294709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddf01c-2f0a-4a0f-9512-1e25021804c8 service swift] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:36.294998 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddf01c-2f0a-4a0f-9512-1e25021804c8 service swift] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:36.295272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddf01c-2f0a-4a0f-9512-1e25021804c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:36.304648 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddf01c-2f0a-4a0f-9512-1e25021804c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:36.306317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddf01c-2f0a-4a0f-9512-1e25021804c8 service swift] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:36.315093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1239/2464] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:42:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 14:42:41.980940 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f3177-6db5-44f1-88ec-bcab1d79d079 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:41.981487 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f3177-6db5-44f1-88ec-bcab1d79d079 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:41.981487 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f3177-6db5-44f1-88ec-bcab1d79d079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:42.039867 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-dc5f3177-6db5-44f1-88ec-bcab1d79d079 None None] MFA Rules not processed for user `c1a6ff2d8f214df9810da0000bfe9e79`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:42:42.041371 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-dc5f3177-6db5-44f1-88ec-bcab1d79d079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:42.127030 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1226/2465] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:42:41 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:42:42.138990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddf01c-2f0a-4a0f-9512-1e25021804c8 service swift] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:42.158283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddf01c-2f0a-4a0f-9512-1e25021804c8 service swift] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:42.171061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c736f-961a-4959-96a5-fe8491990916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:42.171900 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c736f-961a-4959-96a5-fe8491990916 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:42.172186 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c736f-961a-4959-96a5-fe8491990916 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:42.172464 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c736f-961a-4959-96a5-fe8491990916 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:42.173163 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c736f-961a-4959-96a5-fe8491990916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:42.175117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c736f-961a-4959-96a5-fe8491990916 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:42.299434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1240/2466] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:42:42 2021] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:42:42.302985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f3177-6db5-44f1-88ec-bcab1d79d079 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:42.317636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f3177-6db5-44f1-88ec-bcab1d79d079 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:42.384602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4c8d4-5340-4262-bfad-fd0e7d9b1397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:42.385439 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4c8d4-5340-4262-bfad-fd0e7d9b1397 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:42.385725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4c8d4-5340-4262-bfad-fd0e7d9b1397 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:42.386165 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4c8d4-5340-4262-bfad-fd0e7d9b1397 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:42.386866 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4c8d4-5340-4262-bfad-fd0e7d9b1397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:42.389979 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4c8d4-5340-4262-bfad-fd0e7d9b1397 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:42.501494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1227/2467] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:42:42 2021] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:42:42.505200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c736f-961a-4959-96a5-fe8491990916 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:42.515797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c736f-961a-4959-96a5-fe8491990916 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:42.520675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74895ce4-4e2b-47bd-8f1e-ebe8cc4c69a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:42.521352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74895ce4-4e2b-47bd-8f1e-ebe8cc4c69a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:42.521634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74895ce4-4e2b-47bd-8f1e-ebe8cc4c69a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:42.521992 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74895ce4-4e2b-47bd-8f1e-ebe8cc4c69a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:42.522827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74895ce4-4e2b-47bd-8f1e-ebe8cc4c69a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:42.524455 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74895ce4-4e2b-47bd-8f1e-ebe8cc4c69a8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:42.538157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1241/2468] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:42:42 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:42:42.542467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4c8d4-5340-4262-bfad-fd0e7d9b1397 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:42.555999 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4c8d4-5340-4262-bfad-fd0e7d9b1397 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:42.560940 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856d729-8b69-42d4-b8f1-0cf39347003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:42.561944 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856d729-8b69-42d4-b8f1-0cf39347003a admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:42.562256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856d729-8b69-42d4-b8f1-0cf39347003a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:42.562510 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856d729-8b69-42d4-b8f1-0cf39347003a admin admin] PATH_INFO: `/v3/projects/5bdb3a934c224eafb85968cce7cdf3e4/users/e23dd5b9e58f4060b3cd1e53a2b91fa3/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:42.583849 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856d729-8b69-42d4-b8f1-0cf39347003a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdb3a934c224eafb85968cce7cdf3e4, user_id=e23dd5b9e58f4060b3cd1e53a2b91fa3, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:42.587337 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856d729-8b69-42d4-b8f1-0cf39347003a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:42.714911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1228/2469] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:42:42 2021] PUT /identity/v3/projects/5bdb3a934c224eafb85968cce7cdf3e4/users/e23dd5b9e58f4060b3cd1e53a2b91fa3/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:42:42.719754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74895ce4-4e2b-47bd-8f1e-ebe8cc4c69a8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:42.730368 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74895ce4-4e2b-47bd-8f1e-ebe8cc4c69a8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:42.791650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0ce7f-be31-4b35-b784-2a1c6ad13f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:42.792613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0ce7f-be31-4b35-b784-2a1c6ad13f96 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:42.792896 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0ce7f-be31-4b35-b784-2a1c6ad13f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:42.793166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0ce7f-be31-4b35-b784-2a1c6ad13f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:42.793940 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0ce7f-be31-4b35-b784-2a1c6ad13f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:42.796135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0ce7f-be31-4b35-b784-2a1c6ad13f96 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:42.807929 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1242/2470] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:42:42 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:42:42.814235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856d729-8b69-42d4-b8f1-0cf39347003a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:42.824357 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856d729-8b69-42d4-b8f1-0cf39347003a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:42.829072 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd180257-9728-42c2-a7e3-60f6e3d8ad41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:42.830195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd180257-9728-42c2-a7e3-60f6e3d8ad41 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:42.830588 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd180257-9728-42c2-a7e3-60f6e3d8ad41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:42.831024 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd180257-9728-42c2-a7e3-60f6e3d8ad41 admin admin] PATH_INFO: `/v3/projects/5bdb3a934c224eafb85968cce7cdf3e4/users/e23dd5b9e58f4060b3cd1e53a2b91fa3/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:42.833917 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd180257-9728-42c2-a7e3-60f6e3d8ad41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdb3a934c224eafb85968cce7cdf3e4, user_id=e23dd5b9e58f4060b3cd1e53a2b91fa3, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:42.838138 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd180257-9728-42c2-a7e3-60f6e3d8ad41 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:42.851160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1229/2471] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:42:42 2021] PUT /identity/v3/projects/5bdb3a934c224eafb85968cce7cdf3e4/users/e23dd5b9e58f4060b3cd1e53a2b91fa3/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:42:51.358406 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1c152-1bde-4752-91c7-a7d85cf27b6e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:51.359040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1c152-1bde-4752-91c7-a7d85cf27b6e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:51.359040 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1c152-1bde-4752-91c7-a7d85cf27b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:51.391628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-19b1c152-1bde-4752-91c7-a7d85cf27b6e None None] MFA Rules not processed for user `e23dd5b9e58f4060b3cd1e53a2b91fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:42:51.393088 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-19b1c152-1bde-4752-91c7-a7d85cf27b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:51.466163 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1243/2472] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:42:51 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:42:51.485121 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd180257-9728-42c2-a7e3-60f6e3d8ad41 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:51.487702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-bd180257-9728-42c2-a7e3-60f6e3d8ad41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:51.581789 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd180257-9728-42c2-a7e3-60f6e3d8ad41 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:51.586363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144174c9-39f9-4143-852d-901572fd9c45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db83070471e34df695b571cdab440b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:51.587012 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144174c9-39f9-4143-852d-901572fd9c45 service glance] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:51.587458 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144174c9-39f9-4143-852d-901572fd9c45 service glance] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:51.587734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144174c9-39f9-4143-852d-901572fd9c45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:51.647644 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144174c9-39f9-4143-852d-901572fd9c45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:51.649078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144174c9-39f9-4143-852d-901572fd9c45 service glance] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:51.658733 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1230/2473] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:42:51 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:42:51.897386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a398-859f-485f-80db-f24ee33f6b15 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:51.897677 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a398-859f-485f-80db-f24ee33f6b15 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:51.898021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a398-859f-485f-80db-f24ee33f6b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:51.917631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-7a15a398-859f-485f-80db-f24ee33f6b15 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:42:51.918864 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7a15a398-859f-485f-80db-f24ee33f6b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:51.973616 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1244/2474] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:42:51 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:42:51.987402 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144174c9-39f9-4143-852d-901572fd9c45 service glance] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:52.050627 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144174c9-39f9-4143-852d-901572fd9c45 service glance] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:52.055609 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537340-9384-4588-91cd-dc42d9c00a94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:52.056248 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537340-9384-4588-91cd-dc42d9c00a94 service swift] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:52.056528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537340-9384-4588-91cd-dc42d9c00a94 service swift] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:52.056805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537340-9384-4588-91cd-dc42d9c00a94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:52.064648 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9537340-9384-4588-91cd-dc42d9c00a94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:52.066254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9537340-9384-4588-91cd-dc42d9c00a94 service swift] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:52.073989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1231/2475] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:42:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 14:42:52.678617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e756e2-b661-42e3-b054-f6ba7a228ed4 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:52.679981 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e756e2-b661-42e3-b054-f6ba7a228ed4 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:52.680419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e756e2-b661-42e3-b054-f6ba7a228ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:52.705768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-b0e756e2-b661-42e3-b054-f6ba7a228ed4 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:42:52.707311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b0e756e2-b661-42e3-b054-f6ba7a228ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:52.730623 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1245/2476] 10.222.0.16 () {58 vars in 968 bytes} [Sun Aug 29 14:42:52 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:42:52.737694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537340-9384-4588-91cd-dc42d9c00a94 service swift] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:52.751251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537340-9384-4588-91cd-dc42d9c00a94 service swift] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:52.756886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0151ab9-7f9c-461a-b8a8-484036a416d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:52.757778 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0151ab9-7f9c-461a-b8a8-484036a416d7 service swift] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:52.758257 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0151ab9-7f9c-461a-b8a8-484036a416d7 service swift] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:52.758692 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0151ab9-7f9c-461a-b8a8-484036a416d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:52.771694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0151ab9-7f9c-461a-b8a8-484036a416d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:52.773362 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0151ab9-7f9c-461a-b8a8-484036a416d7 service swift] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:52.791850 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1232/2477] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:42:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 14:42:58.501617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e756e2-b661-42e3-b054-f6ba7a228ed4 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:42:58.569261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e756e2-b661-42e3-b054-f6ba7a228ed4 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:42:58.573563 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb2be-e1dd-4925-bf9d-204c46615a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:42:58.574355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb2be-e1dd-4925-bf9d-204c46615a9d service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:42:58.574675 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb2be-e1dd-4925-bf9d-204c46615a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:42:58.574986 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb2be-e1dd-4925-bf9d-204c46615a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:42:58.579683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-575fb2be-e1dd-4925-bf9d-204c46615a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:42:58.650901 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fb2be-e1dd-4925-bf9d-204c46615a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:42:58.652606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fb2be-e1dd-4925-bf9d-204c46615a9d service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:42:58.663582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1246/2478] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:42:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:03.012260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfd170-7b6c-4acc-af58-70df3a917810 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:03.012929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfd170-7b6c-4acc-af58-70df3a917810 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:03.012929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfd170-7b6c-4acc-af58-70df3a917810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:03.030780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-74cfd170-7b6c-4acc-af58-70df3a917810 None None] MFA Rules not processed for user `c1a6ff2d8f214df9810da0000bfe9e79`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:03.031978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-74cfd170-7b6c-4acc-af58-70df3a917810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:03.039117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1233/2479] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:03 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:03.389689 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb2be-e1dd-4925-bf9d-204c46615a9d service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:03.391175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-575fb2be-e1dd-4925-bf9d-204c46615a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:03.408646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb2be-e1dd-4925-bf9d-204c46615a9d service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:03.413239 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25adade-917b-462a-8b7c-4c45bd0aba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:03.414143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25adade-917b-462a-8b7c-4c45bd0aba9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:03.414415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25adade-917b-462a-8b7c-4c45bd0aba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:03.414680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25adade-917b-462a-8b7c-4c45bd0aba9f admin admin] PATH_INFO: `/v3/users/c60cd9a36fad47d98458b8c0e28f3ea3` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:03.415874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25adade-917b-462a-8b7c-4c45bd0aba9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60cd9a36fad47d98458b8c0e28f3ea3)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:03.417785 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25adade-917b-462a-8b7c-4c45bd0aba9f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:03.598158 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c25adade-917b-462a-8b7c-4c45bd0aba9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60cd9a36fad47d98458b8c0e28f3ea3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:03.599077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c25adade-917b-462a-8b7c-4c45bd0aba9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60cd9a36fad47d98458b8c0e28f3ea3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:03.599718 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c25adade-917b-462a-8b7c-4c45bd0aba9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60cd9a36fad47d98458b8c0e28f3ea3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:03.647017 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c25adade-917b-462a-8b7c-4c45bd0aba9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60cd9a36fad47d98458b8c0e28f3ea3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:03.661262 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-c25adade-917b-462a-8b7c-4c45bd0aba9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60cd9a36fad47d98458b8c0e28f3ea3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:03.674106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1247/2480] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:43:03 2021] DELETE /identity/v3/users/c60cd9a36fad47d98458b8c0e28f3ea3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:03.917041 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfd170-7b6c-4acc-af58-70df3a917810 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:03.930422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfd170-7b6c-4acc-af58-70df3a917810 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:03.988461 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d05ca-f237-413a-97ae-fe094546ae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:03.989328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d05ca-f237-413a-97ae-fe094546ae89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:03.989609 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d05ca-f237-413a-97ae-fe094546ae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:03.989906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d05ca-f237-413a-97ae-fe094546ae89 admin admin] PATH_INFO: `/v3/projects/49b2184f7302404ab91b419e21067663` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:03.991093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d05ca-f237-413a-97ae-fe094546ae89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b2184f7302404ab91b419e21067663)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:03.992990 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d05ca-f237-413a-97ae-fe094546ae89 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:04.092777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-282d05ca-f237-413a-97ae-fe094546ae89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b2184f7302404ab91b419e21067663', 'request_id': 'req-282d05ca-f237-413a-97ae-fe094546ae89'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:04.144220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-282d05ca-f237-413a-97ae-fe094546ae89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b2184f7302404ab91b419e21067663', 'request_id': 'req-282d05ca-f237-413a-97ae-fe094546ae89'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:04.149941 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-282d05ca-f237-413a-97ae-fe094546ae89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b2184f7302404ab91b419e21067663', 'request_id': 'req-282d05ca-f237-413a-97ae-fe094546ae89'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:04.161463 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-282d05ca-f237-413a-97ae-fe094546ae89 admin admin] The token cache is being invalidate because project 49b2184f7302404ab91b419e21067663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:43:04.161750 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-282d05ca-f237-413a-97ae-fe094546ae89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:04.162429 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-282d05ca-f237-413a-97ae-fe094546ae89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:04.164030 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1234/2481] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:43:03 2021] DELETE /identity/v3/projects/49b2184f7302404ab91b419e21067663 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:43:04.170097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1d474-4f9c-4b86-864d-cebeb2bbbb52 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:04.170388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1d474-4f9c-4b86-864d-cebeb2bbbb52 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:04.170666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1d474-4f9c-4b86-864d-cebeb2bbbb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:04.188267 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-79a1d474-4f9c-4b86-864d-cebeb2bbbb52 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:04.189637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-79a1d474-4f9c-4b86-864d-cebeb2bbbb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:04.246157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1248/2482] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:43:04.254785 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aec1cd-e795-4363-99aa-cc43bc8e0ea7 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:04.255077 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aec1cd-e795-4363-99aa-cc43bc8e0ea7 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:04.255351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aec1cd-e795-4363-99aa-cc43bc8e0ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:04.274989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-61aec1cd-e795-4363-99aa-cc43bc8e0ea7 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:04.276183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-61aec1cd-e795-4363-99aa-cc43bc8e0ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:04.284303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1235/2483] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:04.297537 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1d474-4f9c-4b86-864d-cebeb2bbbb52 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:04.307173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1d474-4f9c-4b86-864d-cebeb2bbbb52 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:04.312485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705911af-cec5-4205-aeef-170a466884fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:04.313130 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705911af-cec5-4205-aeef-170a466884fd admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:04.313415 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705911af-cec5-4205-aeef-170a466884fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:04.313687 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705911af-cec5-4205-aeef-170a466884fd admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:04.314435 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705911af-cec5-4205-aeef-170a466884fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:43:04.314741 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705911af-cec5-4205-aeef-170a466884fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:04.316322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705911af-cec5-4205-aeef-170a466884fd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:04.328221 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1249/2484] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:43:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:43:04.332545 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aec1cd-e795-4363-99aa-cc43bc8e0ea7 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:04.342061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aec1cd-e795-4363-99aa-cc43bc8e0ea7 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:04.346711 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288b5c1-1e67-476c-b79e-ed88ae2cb278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:04.347361 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288b5c1-1e67-476c-b79e-ed88ae2cb278 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:04.347645 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288b5c1-1e67-476c-b79e-ed88ae2cb278 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:04.347921 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288b5c1-1e67-476c-b79e-ed88ae2cb278 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:04.348634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288b5c1-1e67-476c-b79e-ed88ae2cb278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:04.350839 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288b5c1-1e67-476c-b79e-ed88ae2cb278 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:04.483027 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1236/2485] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:43:04 2021] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:43:04.487140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705911af-cec5-4205-aeef-170a466884fd admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:04.497714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705911af-cec5-4205-aeef-170a466884fd admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:04.552747 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf68ac-791a-4397-8e2c-0b6d9b967237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:04.553412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf68ac-791a-4397-8e2c-0b6d9b967237 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:04.553695 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf68ac-791a-4397-8e2c-0b6d9b967237 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:04.554047 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf68ac-791a-4397-8e2c-0b6d9b967237 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:04.554754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf68ac-791a-4397-8e2c-0b6d9b967237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:04.556659 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf68ac-791a-4397-8e2c-0b6d9b967237 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:04.676818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1250/2486] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:43:04 2021] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:04.680736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288b5c1-1e67-476c-b79e-ed88ae2cb278 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:04.691585 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288b5c1-1e67-476c-b79e-ed88ae2cb278 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:04.696131 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d343c6-665b-4d15-bc64-813bc1755499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:04.696777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d343c6-665b-4d15-bc64-813bc1755499 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:04.697056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d343c6-665b-4d15-bc64-813bc1755499 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:04.697327 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d343c6-665b-4d15-bc64-813bc1755499 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:04.698070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d343c6-665b-4d15-bc64-813bc1755499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:04.699718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d343c6-665b-4d15-bc64-813bc1755499 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:04.710193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1237/2487] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:04.719222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf68ac-791a-4397-8e2c-0b6d9b967237 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:04.729774 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf68ac-791a-4397-8e2c-0b6d9b967237 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:04.736500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1792f-85a1-4828-a9e0-b0a79ebdb97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:04.737291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1792f-85a1-4828-a9e0-b0a79ebdb97c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:04.737291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1792f-85a1-4828-a9e0-b0a79ebdb97c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:04.737559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1792f-85a1-4828-a9e0-b0a79ebdb97c admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:04.738255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1792f-85a1-4828-a9e0-b0a79ebdb97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:04.739920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1792f-85a1-4828-a9e0-b0a79ebdb97c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:04.751945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1251/2488] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:04 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:04.756295 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d343c6-665b-4d15-bc64-813bc1755499 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:04.766311 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d343c6-665b-4d15-bc64-813bc1755499 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:04.770871 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186a1ab-64ea-4c26-8b4c-322bcfcbb2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:04.771736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a1ab-64ea-4c26-8b4c-322bcfcbb2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:04.772014 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a1ab-64ea-4c26-8b4c-322bcfcbb2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:04.772282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a1ab-64ea-4c26-8b4c-322bcfcbb2a0 admin admin] PATH_INFO: `/v3/projects/516a89a19661422192ad844a93bc0500/users/96fec8f8f0a442dabe08b154b03d14cc/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:04.787879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186a1ab-64ea-4c26-8b4c-322bcfcbb2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=516a89a19661422192ad844a93bc0500, user_id=96fec8f8f0a442dabe08b154b03d14cc, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:04.790513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186a1ab-64ea-4c26-8b4c-322bcfcbb2a0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:04.916381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1238/2489] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:04 2021] PUT /identity/v3/projects/516a89a19661422192ad844a93bc0500/users/96fec8f8f0a442dabe08b154b03d14cc/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:43:04.927295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ca1dc-4ebd-4606-b4ec-81dcf0a7ead9 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:04.927581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ca1dc-4ebd-4606-b4ec-81dcf0a7ead9 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:04.927890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ca1dc-4ebd-4606-b4ec-81dcf0a7ead9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:04.958030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-eb0ca1dc-4ebd-4606-b4ec-81dcf0a7ead9 None None] MFA Rules not processed for user `96fec8f8f0a442dabe08b154b03d14cc`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:04.960278 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-eb0ca1dc-4ebd-4606-b4ec-81dcf0a7ead9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:05.026490 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1252/2490] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:04 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:05.031615 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186a1ab-64ea-4c26-8b4c-322bcfcbb2a0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:05.090022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186a1ab-64ea-4c26-8b4c-322bcfcbb2a0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:05.095406 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b2ccd-77bc-437b-b463-6a2ff5482732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:05.096051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b2ccd-77bc-437b-b463-6a2ff5482732 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:05.096331 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b2ccd-77bc-437b-b463-6a2ff5482732 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:05.096603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b2ccd-77bc-437b-b463-6a2ff5482732 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:05.097304 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b2ccd-77bc-437b-b463-6a2ff5482732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:05.099471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b2ccd-77bc-437b-b463-6a2ff5482732 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:05.275689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1239/2491] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:43:05 2021] POST /identity/v3/projects => generated 365 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:43:05.280628 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ca1dc-4ebd-4606-b4ec-81dcf0a7ead9 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:05.291134 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ca1dc-4ebd-4606-b4ec-81dcf0a7ead9 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:05.345375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4035283-d35c-45d0-8459-8b64fa4dfd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:05.346072 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4035283-d35c-45d0-8459-8b64fa4dfd9b admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:05.346353 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4035283-d35c-45d0-8459-8b64fa4dfd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:05.353274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4035283-d35c-45d0-8459-8b64fa4dfd9b admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:05.353274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4035283-d35c-45d0-8459-8b64fa4dfd9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:05.353274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4035283-d35c-45d0-8459-8b64fa4dfd9b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:05.533591 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1253/2492] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:43:05 2021] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:43:05.537848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b2ccd-77bc-437b-b463-6a2ff5482732 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:05.547949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b2ccd-77bc-437b-b463-6a2ff5482732 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:05.552503 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6fee9-970c-46f6-a729-9e70a258d842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:05.553147 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6fee9-970c-46f6-a729-9e70a258d842 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:05.553424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6fee9-970c-46f6-a729-9e70a258d842 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:05.553695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6fee9-970c-46f6-a729-9e70a258d842 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:05.554511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6fee9-970c-46f6-a729-9e70a258d842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:05.556079 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6fee9-970c-46f6-a729-9e70a258d842 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:05.567308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1240/2493] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:05.571447 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4035283-d35c-45d0-8459-8b64fa4dfd9b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:05.581824 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4035283-d35c-45d0-8459-8b64fa4dfd9b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:05.586402 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45460c-28ff-4d2a-a5b1-c40c02746e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:05.587261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45460c-28ff-4d2a-a5b1-c40c02746e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:05.587535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45460c-28ff-4d2a-a5b1-c40c02746e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:05.587803 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45460c-28ff-4d2a-a5b1-c40c02746e42 admin admin] PATH_INFO: `/v3/projects/4f51f49f3030432fb567b33a01a65d71/users/820e08bb23ae4a52880974b233bb7216/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:05.602028 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45460c-28ff-4d2a-a5b1-c40c02746e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f51f49f3030432fb567b33a01a65d71, user_id=820e08bb23ae4a52880974b233bb7216, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:05.604721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45460c-28ff-4d2a-a5b1-c40c02746e42 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:05.721843 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1254/2494] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:05 2021] PUT /identity/v3/projects/4f51f49f3030432fb567b33a01a65d71/users/820e08bb23ae4a52880974b233bb7216/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:43:05.726061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6fee9-970c-46f6-a729-9e70a258d842 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:05.736222 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6fee9-970c-46f6-a729-9e70a258d842 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:05.789122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17779839-9ce1-43d0-984d-c599f9014cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:05.789707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17779839-9ce1-43d0-984d-c599f9014cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:05.790015 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17779839-9ce1-43d0-984d-c599f9014cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:05.790303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17779839-9ce1-43d0-984d-c599f9014cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:05.791003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17779839-9ce1-43d0-984d-c599f9014cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:05.792578 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17779839-9ce1-43d0-984d-c599f9014cd0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:05.801857 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1241/2495] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:05 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:05.806376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45460c-28ff-4d2a-a5b1-c40c02746e42 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:05.816771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45460c-28ff-4d2a-a5b1-c40c02746e42 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:05.821307 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d4363-cd37-464a-bfec-784b164348f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:05.822204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d4363-cd37-464a-bfec-784b164348f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:05.822499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d4363-cd37-464a-bfec-784b164348f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:05.822777 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d4363-cd37-464a-bfec-784b164348f8 admin admin] PATH_INFO: `/v3/projects/4f51f49f3030432fb567b33a01a65d71/users/820e08bb23ae4a52880974b233bb7216/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:05.824746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d4363-cd37-464a-bfec-784b164348f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f51f49f3030432fb567b33a01a65d71, user_id=820e08bb23ae4a52880974b233bb7216, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:05.827993 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d4363-cd37-464a-bfec-784b164348f8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:05.838696 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1255/2496] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:05 2021] PUT /identity/v3/projects/4f51f49f3030432fb567b33a01a65d71/users/820e08bb23ae4a52880974b233bb7216/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:05.849975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598946e7-e31b-477f-846f-1cf7774ee838 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:05.852379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598946e7-e31b-477f-846f-1cf7774ee838 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:05.852379 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598946e7-e31b-477f-846f-1cf7774ee838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:05.880099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-598946e7-e31b-477f-846f-1cf7774ee838 None None] MFA Rules not processed for user `820e08bb23ae4a52880974b233bb7216`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:05.881311 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-598946e7-e31b-477f-846f-1cf7774ee838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:05.948549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1242/2497] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:05 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:05.959941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d4363-cd37-464a-bfec-784b164348f8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:05.961768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5d1d4363-cd37-464a-bfec-784b164348f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:06.019202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d4363-cd37-464a-bfec-784b164348f8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:06.022905 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474cf4d-85fd-4b41-8246-b9d41de1e5fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:06.023559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474cf4d-85fd-4b41-8246-b9d41de1e5fb service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:06.023854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474cf4d-85fd-4b41-8246-b9d41de1e5fb service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:06.024123 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474cf4d-85fd-4b41-8246-b9d41de1e5fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:06.033606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474cf4d-85fd-4b41-8246-b9d41de1e5fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:06.035131 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474cf4d-85fd-4b41-8246-b9d41de1e5fb service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:06.046451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1256/2498] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:05 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:06.526894 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598946e7-e31b-477f-846f-1cf7774ee838 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:06.551391 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e955-05c1-4576-a5cb-f5ba5b78773d None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:06.551847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e955-05c1-4576-a5cb-f5ba5b78773d None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:06.552079 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e955-05c1-4576-a5cb-f5ba5b78773d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:06.571111 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-1b22e955-05c1-4576-a5cb-f5ba5b78773d None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:06.572401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1b22e955-05c1-4576-a5cb-f5ba5b78773d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:06.596645 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598946e7-e31b-477f-846f-1cf7774ee838 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:06.605141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:06.606263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:06.606263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:06.606539 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] PATH_INFO: `/v3/users/96fec8f8f0a442dabe08b154b03d14cc` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:06.607955 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96fec8f8f0a442dabe08b154b03d14cc)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:06.609980 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:06.631437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1257/2499] 10.222.0.16 () {58 vars in 1010 bytes} [Sun Aug 29 14:43:06 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:43:06.645588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22e955-05c1-4576-a5cb-f5ba5b78773d None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:06.647243 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1b22e955-05c1-4576-a5cb-f5ba5b78773d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:06.721246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22e955-05c1-4576-a5cb-f5ba5b78773d None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:06.726964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e6762-8769-4b3d-b148-18b935bbe764 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:06.727724 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e6762-8769-4b3d-b148-18b935bbe764 service swift] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:06.728019 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e6762-8769-4b3d-b148-18b935bbe764 service swift] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:06.728296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e6762-8769-4b3d-b148-18b935bbe764 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:06.736662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e6762-8769-4b3d-b148-18b935bbe764 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:06.738295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e6762-8769-4b3d-b148-18b935bbe764 service swift] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:06.746854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1258/2500] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:43:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 14:43:06.814914 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96fec8f8f0a442dabe08b154b03d14cc'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:06.815568 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96fec8f8f0a442dabe08b154b03d14cc'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:06.822312 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96fec8f8f0a442dabe08b154b03d14cc'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:06.916965 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96fec8f8f0a442dabe08b154b03d14cc'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:06.938362 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96fec8f8f0a442dabe08b154b03d14cc'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:06.952637 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1243/2501] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:43:06 2021] DELETE /identity/v3/users/96fec8f8f0a442dabe08b154b03d14cc => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:06.955542 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e8110-0ea7-46e9-a3e8-6d306142b3a4 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:06.960630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e8110-0ea7-46e9-a3e8-6d306142b3a4 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:06.960630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e8110-0ea7-46e9-a3e8-6d306142b3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:07.009108 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3f8e8110-0ea7-46e9-a3e8-6d306142b3a4 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:07.011586 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3f8e8110-0ea7-46e9-a3e8-6d306142b3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:07.137409 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1259/2502] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:43:07.148329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:07.150152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:07.286073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8622-c1d1-467e-98f4-9a58fc147b31 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:07.294774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50dc60-48e3-4d70-8d04-f3a5d54c8d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:07.295565 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50dc60-48e3-4d70-8d04-f3a5d54c8d6d service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:07.295954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50dc60-48e3-4d70-8d04-f3a5d54c8d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:07.296775 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50dc60-48e3-4d70-8d04-f3a5d54c8d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:07.327974 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50dc60-48e3-4d70-8d04-f3a5d54c8d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:07.329640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50dc60-48e3-4d70-8d04-f3a5d54c8d6d service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:07.352260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1244/2503] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:07.837212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e8110-0ea7-46e9-a3e8-6d306142b3a4 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:07.838622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3f8e8110-0ea7-46e9-a3e8-6d306142b3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:07.852464 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e8110-0ea7-46e9-a3e8-6d306142b3a4 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:07.858326 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:07.859192 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:07.859472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:07.859742 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] PATH_INFO: `/v3/projects/516a89a19661422192ad844a93bc0500` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:07.861638 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=516a89a19661422192ad844a93bc0500)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:07.864073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:08.007063 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '516a89a19661422192ad844a93bc0500', 'request_id': 'req-38c7fcd8-10d5-4b75-b468-ac9505e75b12'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:08.081427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '516a89a19661422192ad844a93bc0500', 'request_id': 'req-38c7fcd8-10d5-4b75-b468-ac9505e75b12'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:08.087800 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '516a89a19661422192ad844a93bc0500', 'request_id': 'req-38c7fcd8-10d5-4b75-b468-ac9505e75b12'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:08.101609 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] The token cache is being invalidate because project 516a89a19661422192ad844a93bc0500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:43:08.102198 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:08.103020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:08.104647 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1260/2504] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:43:07 2021] DELETE /identity/v3/projects/516a89a19661422192ad844a93bc0500 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:08.109076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50dc60-48e3-4d70-8d04-f3a5d54c8d6d service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:08.121069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50dc60-48e3-4d70-8d04-f3a5d54c8d6d service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:08.180919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963d3fd-f738-484d-8df0-903109be5751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:08.181788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963d3fd-f738-484d-8df0-903109be5751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:08.182096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963d3fd-f738-484d-8df0-903109be5751 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:08.182368 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963d3fd-f738-484d-8df0-903109be5751 admin admin] PATH_INFO: `/v3/users/820e08bb23ae4a52880974b233bb7216` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:08.183562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963d3fd-f738-484d-8df0-903109be5751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820e08bb23ae4a52880974b233bb7216)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:08.185543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963d3fd-f738-484d-8df0-903109be5751 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:08.368734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0963d3fd-f738-484d-8df0-903109be5751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820e08bb23ae4a52880974b233bb7216'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:08.369381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0963d3fd-f738-484d-8df0-903109be5751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820e08bb23ae4a52880974b233bb7216'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:08.376528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0963d3fd-f738-484d-8df0-903109be5751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820e08bb23ae4a52880974b233bb7216'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:08.446710 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0963d3fd-f738-484d-8df0-903109be5751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820e08bb23ae4a52880974b233bb7216'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:08.459278 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0963d3fd-f738-484d-8df0-903109be5751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820e08bb23ae4a52880974b233bb7216'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:08.464963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1245/2505] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:43:08 2021] DELETE /identity/v3/users/820e08bb23ae4a52880974b233bb7216 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:08.922706 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:08.924292 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:08.937296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7fcd8-10d5-4b75-b468-ac9505e75b12 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:08.997854 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf5f08-5974-402a-925e-71ebbf85578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:08.998736 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf5f08-5974-402a-925e-71ebbf85578e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:08.999017 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf5f08-5974-402a-925e-71ebbf85578e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:08.999290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf5f08-5974-402a-925e-71ebbf85578e admin admin] PATH_INFO: `/v3/projects/4f51f49f3030432fb567b33a01a65d71` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:09.000461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf5f08-5974-402a-925e-71ebbf85578e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f51f49f3030432fb567b33a01a65d71)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:09.002400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf5f08-5974-402a-925e-71ebbf85578e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:09.115305 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-f7cf5f08-5974-402a-925e-71ebbf85578e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f51f49f3030432fb567b33a01a65d71', 'request_id': 'req-f7cf5f08-5974-402a-925e-71ebbf85578e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:09.177228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-f7cf5f08-5974-402a-925e-71ebbf85578e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f51f49f3030432fb567b33a01a65d71', 'request_id': 'req-f7cf5f08-5974-402a-925e-71ebbf85578e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:09.182670 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-f7cf5f08-5974-402a-925e-71ebbf85578e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f51f49f3030432fb567b33a01a65d71', 'request_id': 'req-f7cf5f08-5974-402a-925e-71ebbf85578e'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:09.194351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-f7cf5f08-5974-402a-925e-71ebbf85578e admin admin] The token cache is being invalidate because project 4f51f49f3030432fb567b33a01a65d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:43:09.194653 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-f7cf5f08-5974-402a-925e-71ebbf85578e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:09.195282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-f7cf5f08-5974-402a-925e-71ebbf85578e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:09.196797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1261/2506] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:43:08 2021] DELETE /identity/v3/projects/4f51f49f3030432fb567b33a01a65d71 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:09.203144 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253a9e-977d-44f2-b480-57edc248445e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:09.203639 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253a9e-977d-44f2-b480-57edc248445e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:09.203752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253a9e-977d-44f2-b480-57edc248445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:09.221850 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c8253a9e-977d-44f2-b480-57edc248445e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:09.223095 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c8253a9e-977d-44f2-b480-57edc248445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:09.300725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1246/2507] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:09.308931 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e2321-640c-4a77-b71e-5a2eb653ba04 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:09.309516 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e2321-640c-4a77-b71e-5a2eb653ba04 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:09.309809 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e2321-640c-4a77-b71e-5a2eb653ba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:09.329291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-e52e2321-640c-4a77-b71e-5a2eb653ba04 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:09.330536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e52e2321-640c-4a77-b71e-5a2eb653ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:09.342636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1262/2508] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:09.343817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253a9e-977d-44f2-b480-57edc248445e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:09.354972 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253a9e-977d-44f2-b480-57edc248445e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:09.360184 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3412d8-385b-4032-bfe2-be0a1c24ecae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:09.360832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3412d8-385b-4032-bfe2-be0a1c24ecae admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:09.361107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3412d8-385b-4032-bfe2-be0a1c24ecae admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:09.361376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3412d8-385b-4032-bfe2-be0a1c24ecae admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:09.362117 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3412d8-385b-4032-bfe2-be0a1c24ecae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:43:09.362416 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3412d8-385b-4032-bfe2-be0a1c24ecae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:09.363994 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3412d8-385b-4032-bfe2-be0a1c24ecae admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:09.375565 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1247/2509] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:43:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:43:09.379887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e2321-640c-4a77-b71e-5a2eb653ba04 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:09.388932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e2321-640c-4a77-b71e-5a2eb653ba04 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:09.393501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308e197-e53c-46ab-b64d-ce93e3ad34b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:09.394231 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308e197-e53c-46ab-b64d-ce93e3ad34b3 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:09.394509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308e197-e53c-46ab-b64d-ce93e3ad34b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:09.394776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308e197-e53c-46ab-b64d-ce93e3ad34b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:09.395451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308e197-e53c-46ab-b64d-ce93e3ad34b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:09.397303 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308e197-e53c-46ab-b64d-ce93e3ad34b3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:09.493149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1263/2510] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:43:09 2021] POST /identity/v3/projects => generated 407 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:43:09.497467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3412d8-385b-4032-bfe2-be0a1c24ecae admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:09.507656 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3412d8-385b-4032-bfe2-be0a1c24ecae admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:09.570907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b34ce3-bc82-47a1-abd6-ef146c22144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:09.571614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b34ce3-bc82-47a1-abd6-ef146c22144f admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:09.571963 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b34ce3-bc82-47a1-abd6-ef146c22144f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:09.572266 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b34ce3-bc82-47a1-abd6-ef146c22144f admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:09.572983 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b34ce3-bc82-47a1-abd6-ef146c22144f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:09.577825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b34ce3-bc82-47a1-abd6-ef146c22144f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:09.658591 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1248/2511] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:43:09 2021] POST /identity/v3/users => generated 304 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:09.662328 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308e197-e53c-46ab-b64d-ce93e3ad34b3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:09.672782 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308e197-e53c-46ab-b64d-ce93e3ad34b3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:09.677408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468fad2-4ca4-4fad-850a-cf05f4c55a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:09.678092 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468fad2-4ca4-4fad-850a-cf05f4c55a6f admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:09.678375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468fad2-4ca4-4fad-850a-cf05f4c55a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:09.678648 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468fad2-4ca4-4fad-850a-cf05f4c55a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:09.679362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468fad2-4ca4-4fad-850a-cf05f4c55a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:09.680999 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468fad2-4ca4-4fad-850a-cf05f4c55a6f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:09.691697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1264/2512] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:43:09.695992 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b34ce3-bc82-47a1-abd6-ef146c22144f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:09.707210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b34ce3-bc82-47a1-abd6-ef146c22144f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:09.711985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc46419-cbab-4329-8aad-4f02f0283ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:09.712634 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc46419-cbab-4329-8aad-4f02f0283ddf admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:09.712912 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc46419-cbab-4329-8aad-4f02f0283ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:09.713178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc46419-cbab-4329-8aad-4f02f0283ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:09.713910 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc46419-cbab-4329-8aad-4f02f0283ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:09.724994 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc46419-cbab-4329-8aad-4f02f0283ddf admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:09.735501 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1249/2513] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:09 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:09.737196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468fad2-4ca4-4fad-850a-cf05f4c55a6f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:09.748057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468fad2-4ca4-4fad-850a-cf05f4c55a6f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:09.754897 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d36fcd-68e5-456d-9e26-0120f8a6a978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:09.756392 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d36fcd-68e5-456d-9e26-0120f8a6a978 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:09.756822 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d36fcd-68e5-456d-9e26-0120f8a6a978 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:09.757235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d36fcd-68e5-456d-9e26-0120f8a6a978 admin admin] PATH_INFO: `/v3/projects/7fc0fef0576e4b9780d9e019fd9b9049/users/8b9ab1e75b6b4f8da18dfbdcf022669f/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:09.781499 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d36fcd-68e5-456d-9e26-0120f8a6a978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc0fef0576e4b9780d9e019fd9b9049, user_id=8b9ab1e75b6b4f8da18dfbdcf022669f, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:09.785230 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d36fcd-68e5-456d-9e26-0120f8a6a978 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:09.864754 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1265/2514] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:09 2021] PUT /identity/v3/projects/7fc0fef0576e4b9780d9e019fd9b9049/users/8b9ab1e75b6b4f8da18dfbdcf022669f/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:43:09.875245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85591b89-3fe9-4f90-a720-331ae954945f None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:09.875560 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85591b89-3fe9-4f90-a720-331ae954945f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:09.875838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85591b89-3fe9-4f90-a720-331ae954945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:09.904236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-85591b89-3fe9-4f90-a720-331ae954945f None None] MFA Rules not processed for user `8b9ab1e75b6b4f8da18dfbdcf022669f`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:09.905453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-85591b89-3fe9-4f90-a720-331ae954945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:09.968007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1250/2515] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:09 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:43:09.972659 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d36fcd-68e5-456d-9e26-0120f8a6a978 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:10.031338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d36fcd-68e5-456d-9e26-0120f8a6a978 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:10.035992 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ccbed-ac1c-4c7b-b2c2-577fd413e53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:10.036642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ccbed-ac1c-4c7b-b2c2-577fd413e53f admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:10.036920 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ccbed-ac1c-4c7b-b2c2-577fd413e53f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:10.037189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ccbed-ac1c-4c7b-b2c2-577fd413e53f admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:10.037922 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ccbed-ac1c-4c7b-b2c2-577fd413e53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:10.039802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ccbed-ac1c-4c7b-b2c2-577fd413e53f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:10.167820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1266/2516] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:43:09 2021] POST /identity/v3/projects => generated 409 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:43:10.172120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85591b89-3fe9-4f90-a720-331ae954945f None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:10.182657 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85591b89-3fe9-4f90-a720-331ae954945f None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:10.240244 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e32e4-14f1-44d7-a6ba-c8d5feefe171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:10.242126 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e32e4-14f1-44d7-a6ba-c8d5feefe171 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:10.242816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e32e4-14f1-44d7-a6ba-c8d5feefe171 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:10.243347 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e32e4-14f1-44d7-a6ba-c8d5feefe171 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:10.244533 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e32e4-14f1-44d7-a6ba-c8d5feefe171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:10.248080 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e32e4-14f1-44d7-a6ba-c8d5feefe171 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:10.361065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1251/2517] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:43:10 2021] POST /identity/v3/users => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:10.364875 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ccbed-ac1c-4c7b-b2c2-577fd413e53f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:10.375771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ccbed-ac1c-4c7b-b2c2-577fd413e53f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:10.380363 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6a21d-9ba8-48cd-8dae-a1cbcc04122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:10.381078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6a21d-9ba8-48cd-8dae-a1cbcc04122d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:10.381357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6a21d-9ba8-48cd-8dae-a1cbcc04122d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:10.381634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6a21d-9ba8-48cd-8dae-a1cbcc04122d admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:10.382451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6a21d-9ba8-48cd-8dae-a1cbcc04122d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:10.384059 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6a21d-9ba8-48cd-8dae-a1cbcc04122d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:10.398833 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1267/2518] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:10 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:43:10.400155 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e32e4-14f1-44d7-a6ba-c8d5feefe171 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:10.411791 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e32e4-14f1-44d7-a6ba-c8d5feefe171 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:10.416690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95249c3a-3cdd-4104-9c16-2592e794d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:10.417583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95249c3a-3cdd-4104-9c16-2592e794d62b admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:10.417882 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95249c3a-3cdd-4104-9c16-2592e794d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:10.418161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95249c3a-3cdd-4104-9c16-2592e794d62b admin admin] PATH_INFO: `/v3/projects/814f8226275f4adeaf4b15edba9f0346/users/1cc000defeaa4d639d3027a87ac1ab10/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:10.433788 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95249c3a-3cdd-4104-9c16-2592e794d62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=814f8226275f4adeaf4b15edba9f0346, user_id=1cc000defeaa4d639d3027a87ac1ab10, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:10.437083 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95249c3a-3cdd-4104-9c16-2592e794d62b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:10.531743 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1252/2519] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:10 2021] PUT /identity/v3/projects/814f8226275f4adeaf4b15edba9f0346/users/1cc000defeaa4d639d3027a87ac1ab10/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:10.535744 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6a21d-9ba8-48cd-8dae-a1cbcc04122d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:10.546452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6a21d-9ba8-48cd-8dae-a1cbcc04122d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:10.601046 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e22fe-5e6d-4292-a189-200cec039efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:10.601714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e22fe-5e6d-4292-a189-200cec039efa admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:10.602156 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e22fe-5e6d-4292-a189-200cec039efa admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:10.602442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e22fe-5e6d-4292-a189-200cec039efa admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:10.603157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e22fe-5e6d-4292-a189-200cec039efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:10.604750 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e22fe-5e6d-4292-a189-200cec039efa admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:10.615508 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1268/2520] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:10 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:43:10.619580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95249c3a-3cdd-4104-9c16-2592e794d62b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:10.630500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95249c3a-3cdd-4104-9c16-2592e794d62b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:10.635188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad4cb6-e1e0-4ba2-9892-08073682f890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:10.636056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad4cb6-e1e0-4ba2-9892-08073682f890 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:10.636335 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad4cb6-e1e0-4ba2-9892-08073682f890 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:10.636632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad4cb6-e1e0-4ba2-9892-08073682f890 admin admin] PATH_INFO: `/v3/projects/814f8226275f4adeaf4b15edba9f0346/users/1cc000defeaa4d639d3027a87ac1ab10/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:10.638678 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad4cb6-e1e0-4ba2-9892-08073682f890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814f8226275f4adeaf4b15edba9f0346, user_id=1cc000defeaa4d639d3027a87ac1ab10, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:10.641305 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad4cb6-e1e0-4ba2-9892-08073682f890 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:10.652092 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1253/2521] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:10 2021] PUT /identity/v3/projects/814f8226275f4adeaf4b15edba9f0346/users/1cc000defeaa4d639d3027a87ac1ab10/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:10.664074 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7ed26-9aa9-45b9-9e19-cf8ced146d01 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:10.664361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7ed26-9aa9-45b9-9e19-cf8ced146d01 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:10.664639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7ed26-9aa9-45b9-9e19-cf8ced146d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:10.696148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-f9a7ed26-9aa9-45b9-9e19-cf8ced146d01 None None] MFA Rules not processed for user `1cc000defeaa4d639d3027a87ac1ab10`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:10.698057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f9a7ed26-9aa9-45b9-9e19-cf8ced146d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:10.790752 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1269/2522] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:10 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:10.797260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad4cb6-e1e0-4ba2-9892-08073682f890 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:10.799167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4cad4cb6-e1e0-4ba2-9892-08073682f890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:10.875998 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad4cb6-e1e0-4ba2-9892-08073682f890 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:10.879572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd94c-94ff-4e10-aba2-f3637b3512ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:10.880209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd94c-94ff-4e10-aba2-f3637b3512ad service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:10.880483 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd94c-94ff-4e10-aba2-f3637b3512ad service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:10.880751 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd94c-94ff-4e10-aba2-f3637b3512ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:10.890336 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afd94c-94ff-4e10-aba2-f3637b3512ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:10.891751 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afd94c-94ff-4e10-aba2-f3637b3512ad service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:10.901212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1254/2523] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:10 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:11.308220 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7ed26-9aa9-45b9-9e19-cf8ced146d01 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:11.320681 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7ed26-9aa9-45b9-9e19-cf8ced146d01 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:11.324318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bae38-3048-458a-ad32-1e6b44993c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:11.324964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bae38-3048-458a-ad32-1e6b44993c25 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:11.325244 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bae38-3048-458a-ad32-1e6b44993c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:11.325516 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bae38-3048-458a-ad32-1e6b44993c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:11.386662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bae38-3048-458a-ad32-1e6b44993c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:11.388804 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bae38-3048-458a-ad32-1e6b44993c25 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:11.399455 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1270/2524] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:11 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:22.510926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd94c-94ff-4e10-aba2-f3637b3512ad service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:22.575411 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd94c-94ff-4e10-aba2-f3637b3512ad service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:22.580652 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:22.581593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:22.581887 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:22.582167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] PATH_INFO: `/v3/users/8b9ab1e75b6b4f8da18dfbdcf022669f` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:22.583337 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9ab1e75b6b4f8da18dfbdcf022669f)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:22.585264 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:22.735363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9ab1e75b6b4f8da18dfbdcf022669f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:22.736096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9ab1e75b6b4f8da18dfbdcf022669f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:22.743747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9ab1e75b6b4f8da18dfbdcf022669f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:22.789437 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9ab1e75b6b4f8da18dfbdcf022669f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:22.801446 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9ab1e75b6b4f8da18dfbdcf022669f'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:22.807340 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1255/2525] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:43:22 2021] DELETE /identity/v3/users/8b9ab1e75b6b4f8da18dfbdcf022669f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:43:22.812591 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f58631-db73-49bf-a6f8-aec967b76beb None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:22.813478 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f58631-db73-49bf-a6f8-aec967b76beb None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:22.813761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f58631-db73-49bf-a6f8-aec967b76beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:22.833276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-22f58631-db73-49bf-a6f8-aec967b76beb None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:22.834509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-22f58631-db73-49bf-a6f8-aec967b76beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:22.901644 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1271/2526] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:22.912465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:22.913917 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:22.971745 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7172869-8201-4360-875d-8d820052a1a9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:22.975751 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929c80-dcab-49da-9800-993735edc497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:22.976386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929c80-dcab-49da-9800-993735edc497 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:22.976661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929c80-dcab-49da-9800-993735edc497 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:22.976929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929c80-dcab-49da-9800-993735edc497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:22.987391 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59929c80-dcab-49da-9800-993735edc497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:22.989128 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59929c80-dcab-49da-9800-993735edc497 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:22.999540 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1256/2527] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:43:23.438151 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f58631-db73-49bf-a6f8-aec967b76beb None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:23.439652 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-22f58631-db73-49bf-a6f8-aec967b76beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:23.453933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f58631-db73-49bf-a6f8-aec967b76beb None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:23.459374 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:23.460451 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:23.460742 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:23.461041 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] PATH_INFO: `/v3/projects/7fc0fef0576e4b9780d9e019fd9b9049` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:23.462191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc0fef0576e4b9780d9e019fd9b9049)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:23.464132 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:23.578592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc0fef0576e4b9780d9e019fd9b9049', 'request_id': 'req-a3bc1b29-18f2-4d31-9d34-410efd1d1177'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:23.652520 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc0fef0576e4b9780d9e019fd9b9049', 'request_id': 'req-a3bc1b29-18f2-4d31-9d34-410efd1d1177'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:23.658759 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc0fef0576e4b9780d9e019fd9b9049', 'request_id': 'req-a3bc1b29-18f2-4d31-9d34-410efd1d1177'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:23.669948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] The token cache is being invalidate because project 7fc0fef0576e4b9780d9e019fd9b9049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:43:23.670182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:23.670837 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:23.672731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1272/2528] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:43:23 2021] DELETE /identity/v3/projects/7fc0fef0576e4b9780d9e019fd9b9049 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:23.676749 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929c80-dcab-49da-9800-993735edc497 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:23.687037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929c80-dcab-49da-9800-993735edc497 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:23.751640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5d157-d5a2-4562-863c-e15787655ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:23.751640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5d157-d5a2-4562-863c-e15787655ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:23.751640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5d157-d5a2-4562-863c-e15787655ada admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:23.751640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5d157-d5a2-4562-863c-e15787655ada admin admin] PATH_INFO: `/v3/users/1cc000defeaa4d639d3027a87ac1ab10` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:23.752060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5d157-d5a2-4562-863c-e15787655ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc000defeaa4d639d3027a87ac1ab10)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:23.752060 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5d157-d5a2-4562-863c-e15787655ada admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:23.984580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d4d5d157-d5a2-4562-863c-e15787655ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc000defeaa4d639d3027a87ac1ab10'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:23.985288 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d4d5d157-d5a2-4562-863c-e15787655ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc000defeaa4d639d3027a87ac1ab10'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:23.992220 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d4d5d157-d5a2-4562-863c-e15787655ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc000defeaa4d639d3027a87ac1ab10'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:24.086256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d4d5d157-d5a2-4562-863c-e15787655ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc000defeaa4d639d3027a87ac1ab10'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:24.097954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d4d5d157-d5a2-4562-863c-e15787655ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc000defeaa4d639d3027a87ac1ab10'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:24.103993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1257/2529] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:43:23 2021] DELETE /identity/v3/users/1cc000defeaa4d639d3027a87ac1ab10 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:24.539714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:24.541703 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:24.555110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc1b29-18f2-4d31-9d34-410efd1d1177 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:24.610626 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb237523-efde-4edf-8ce8-383ae5e6f562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:24.611483 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb237523-efde-4edf-8ce8-383ae5e6f562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:24.611764 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb237523-efde-4edf-8ce8-383ae5e6f562 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:24.612035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb237523-efde-4edf-8ce8-383ae5e6f562 admin admin] PATH_INFO: `/v3/projects/814f8226275f4adeaf4b15edba9f0346` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:24.613189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb237523-efde-4edf-8ce8-383ae5e6f562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=814f8226275f4adeaf4b15edba9f0346)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:24.615118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb237523-efde-4edf-8ce8-383ae5e6f562 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:24.715018 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cb237523-efde-4edf-8ce8-383ae5e6f562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814f8226275f4adeaf4b15edba9f0346', 'request_id': 'req-cb237523-efde-4edf-8ce8-383ae5e6f562'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:24.789819 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cb237523-efde-4edf-8ce8-383ae5e6f562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814f8226275f4adeaf4b15edba9f0346', 'request_id': 'req-cb237523-efde-4edf-8ce8-383ae5e6f562'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:24.795891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cb237523-efde-4edf-8ce8-383ae5e6f562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814f8226275f4adeaf4b15edba9f0346', 'request_id': 'req-cb237523-efde-4edf-8ce8-383ae5e6f562'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:24.807759 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cb237523-efde-4edf-8ce8-383ae5e6f562 admin admin] The token cache is being invalidate because project 814f8226275f4adeaf4b15edba9f0346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:43:24.809934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cb237523-efde-4edf-8ce8-383ae5e6f562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:24.809934 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-cb237523-efde-4edf-8ce8-383ae5e6f562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:24.810437 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1273/2530] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:43:24 2021] DELETE /identity/v3/projects/814f8226275f4adeaf4b15edba9f0346 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:24.816298 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce990c39-f710-404a-a55c-a40679b80a57 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:24.816779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce990c39-f710-404a-a55c-a40679b80a57 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:24.816872 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce990c39-f710-404a-a55c-a40679b80a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:24.836832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-ce990c39-f710-404a-a55c-a40679b80a57 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:24.838537 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ce990c39-f710-404a-a55c-a40679b80a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:24.908926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1258/2531] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:43:24.916366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43734cc-12a1-45df-bccb-d543d10def09 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:24.918756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43734cc-12a1-45df-bccb-d543d10def09 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:24.918756 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43734cc-12a1-45df-bccb-d543d10def09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:24.936022 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d43734cc-12a1-45df-bccb-d543d10def09 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:24.938123 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d43734cc-12a1-45df-bccb-d543d10def09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:24.946013 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1274/2532] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:24.950695 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce990c39-f710-404a-a55c-a40679b80a57 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:24.963219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce990c39-f710-404a-a55c-a40679b80a57 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:24.967814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40253745-58a9-4ac1-afeb-930f5a8b0609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:24.968694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40253745-58a9-4ac1-afeb-930f5a8b0609 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:24.969028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40253745-58a9-4ac1-afeb-930f5a8b0609 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:24.969366 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40253745-58a9-4ac1-afeb-930f5a8b0609 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:24.970210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40253745-58a9-4ac1-afeb-930f5a8b0609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:43:24.970577 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40253745-58a9-4ac1-afeb-930f5a8b0609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:24.972210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40253745-58a9-4ac1-afeb-930f5a8b0609 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:24.987175 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1259/2533] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:43:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:43:24.988290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43734cc-12a1-45df-bccb-d543d10def09 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:24.997495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43734cc-12a1-45df-bccb-d543d10def09 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:25.002976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955da17-c600-4ca7-aa8a-7f979b778131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:25.003631 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955da17-c600-4ca7-aa8a-7f979b778131 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:25.003916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955da17-c600-4ca7-aa8a-7f979b778131 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:25.004194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955da17-c600-4ca7-aa8a-7f979b778131 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:25.004878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955da17-c600-4ca7-aa8a-7f979b778131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:25.006817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955da17-c600-4ca7-aa8a-7f979b778131 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:25.136592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1275/2534] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:43:24 2021] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:25.137774 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40253745-58a9-4ac1-afeb-930f5a8b0609 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:25.148233 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40253745-58a9-4ac1-afeb-930f5a8b0609 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:25.201004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c02a5b-ccea-4ce5-a93d-17d24d77ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:25.201666 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c02a5b-ccea-4ce5-a93d-17d24d77ee60 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:25.202554 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c02a5b-ccea-4ce5-a93d-17d24d77ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:25.202836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c02a5b-ccea-4ce5-a93d-17d24d77ee60 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:25.203512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c02a5b-ccea-4ce5-a93d-17d24d77ee60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:25.205435 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c02a5b-ccea-4ce5-a93d-17d24d77ee60 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:25.274929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1260/2535] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:43:25 2021] POST /identity/v3/users => generated 283 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:25.279174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955da17-c600-4ca7-aa8a-7f979b778131 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:25.289365 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955da17-c600-4ca7-aa8a-7f979b778131 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:25.293994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3285ab6-a46e-46e0-b8b5-5a6f0e3afc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:25.294645 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3285ab6-a46e-46e0-b8b5-5a6f0e3afc14 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:25.294921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3285ab6-a46e-46e0-b8b5-5a6f0e3afc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:25.295192 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3285ab6-a46e-46e0-b8b5-5a6f0e3afc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:25.296431 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3285ab6-a46e-46e0-b8b5-5a6f0e3afc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:25.298150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3285ab6-a46e-46e0-b8b5-5a6f0e3afc14 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:25.308147 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1276/2536] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:25 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:43:25.312880 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c02a5b-ccea-4ce5-a93d-17d24d77ee60 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:25.322574 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c02a5b-ccea-4ce5-a93d-17d24d77ee60 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:25.328611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4e566-f291-4622-bd46-2df6b7aaf004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:25.328611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4e566-f291-4622-bd46-2df6b7aaf004 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:25.328611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4e566-f291-4622-bd46-2df6b7aaf004 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:25.328611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4e566-f291-4622-bd46-2df6b7aaf004 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:25.329099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4e566-f291-4622-bd46-2df6b7aaf004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:25.330703 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4e566-f291-4622-bd46-2df6b7aaf004 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:25.340199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1261/2537] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:25 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:25.344851 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3285ab6-a46e-46e0-b8b5-5a6f0e3afc14 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:25.354923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3285ab6-a46e-46e0-b8b5-5a6f0e3afc14 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:25.360394 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1894d1-a2bd-4fb4-91a6-8e1e24f7116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:25.361261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1894d1-a2bd-4fb4-91a6-8e1e24f7116c admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:25.361541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1894d1-a2bd-4fb4-91a6-8e1e24f7116c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:25.361816 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1894d1-a2bd-4fb4-91a6-8e1e24f7116c admin admin] PATH_INFO: `/v3/projects/41e4e1e2f6cf468a9a02af94ac22e0bb/users/3e1beae441b14e58a8cc0041f87beaa4/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:25.376409 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1894d1-a2bd-4fb4-91a6-8e1e24f7116c admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e4e1e2f6cf468a9a02af94ac22e0bb, user_id=3e1beae441b14e58a8cc0041f87beaa4, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:25.379082 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1894d1-a2bd-4fb4-91a6-8e1e24f7116c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:25.458752 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1277/2538] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:25 2021] PUT /identity/v3/projects/41e4e1e2f6cf468a9a02af94ac22e0bb/users/3e1beae441b14e58a8cc0041f87beaa4/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:43:25.470545 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b56a05-f91d-4223-ba29-5a6ae8db53c0 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:25.470953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b56a05-f91d-4223-ba29-5a6ae8db53c0 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:25.471232 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b56a05-f91d-4223-ba29-5a6ae8db53c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:25.508863 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e6b56a05-f91d-4223-ba29-5a6ae8db53c0 None None] MFA Rules not processed for user `3e1beae441b14e58a8cc0041f87beaa4`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:25.510160 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e6b56a05-f91d-4223-ba29-5a6ae8db53c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:25.572633 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1262/2539] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:25 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:25.577354 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1894d1-a2bd-4fb4-91a6-8e1e24f7116c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:25.640052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1894d1-a2bd-4fb4-91a6-8e1e24f7116c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:25.644627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5931955-7443-48ac-81c2-cdceb8d3519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:25.645271 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931955-7443-48ac-81c2-cdceb8d3519b admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:25.645550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931955-7443-48ac-81c2-cdceb8d3519b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:25.645823 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931955-7443-48ac-81c2-cdceb8d3519b admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:25.646534 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5931955-7443-48ac-81c2-cdceb8d3519b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:25.648428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5931955-7443-48ac-81c2-cdceb8d3519b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:25.751200 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1278/2540] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:43:25 2021] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:43:25.755328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b56a05-f91d-4223-ba29-5a6ae8db53c0 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:25.766390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b56a05-f91d-4223-ba29-5a6ae8db53c0 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:25.820569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10f00e-0f2a-4513-aab2-53a195579423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:25.821212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10f00e-0f2a-4513-aab2-53a195579423 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:25.821500 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10f00e-0f2a-4513-aab2-53a195579423 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:25.821778 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10f00e-0f2a-4513-aab2-53a195579423 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:25.822481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10f00e-0f2a-4513-aab2-53a195579423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:25.824377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10f00e-0f2a-4513-aab2-53a195579423 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:25.939610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1263/2541] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:43:25 2021] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:25.943375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5931955-7443-48ac-81c2-cdceb8d3519b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:25.954001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5931955-7443-48ac-81c2-cdceb8d3519b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:25.958894 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c7589-34c9-4ec6-a925-49179ae5b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:25.959680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c7589-34c9-4ec6-a925-49179ae5b366 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:25.960029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c7589-34c9-4ec6-a925-49179ae5b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:25.960369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c7589-34c9-4ec6-a925-49179ae5b366 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:25.961161 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c7589-34c9-4ec6-a925-49179ae5b366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:25.962841 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c7589-34c9-4ec6-a925-49179ae5b366 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:25.974488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1279/2542] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:25 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:25.978780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10f00e-0f2a-4513-aab2-53a195579423 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:25.989424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10f00e-0f2a-4513-aab2-53a195579423 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:25.994478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909f911-b7a2-47e7-b1f1-a700370b7987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:25.995435 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909f911-b7a2-47e7-b1f1-a700370b7987 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:25.995808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909f911-b7a2-47e7-b1f1-a700370b7987 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:25.996139 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909f911-b7a2-47e7-b1f1-a700370b7987 admin admin] PATH_INFO: `/v3/projects/8dd6c0bb3aea44a3a61bb271d23d17ca/users/faf52c3ca02948f1959504248107ef0c/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:26.011697 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909f911-b7a2-47e7-b1f1-a700370b7987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd6c0bb3aea44a3a61bb271d23d17ca, user_id=faf52c3ca02948f1959504248107ef0c, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:26.014889 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909f911-b7a2-47e7-b1f1-a700370b7987 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:26.081549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1264/2543] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:25 2021] PUT /identity/v3/projects/8dd6c0bb3aea44a3a61bb271d23d17ca/users/faf52c3ca02948f1959504248107ef0c/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:43:26.089401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c7589-34c9-4ec6-a925-49179ae5b366 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:26.100292 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c7589-34c9-4ec6-a925-49179ae5b366 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:26.153763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b33b6-bf6f-4e54-b647-fc10dff662e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:26.154450 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b33b6-bf6f-4e54-b647-fc10dff662e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:26.154728 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b33b6-bf6f-4e54-b647-fc10dff662e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:26.155613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b33b6-bf6f-4e54-b647-fc10dff662e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:26.156296 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b33b6-bf6f-4e54-b647-fc10dff662e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:26.157970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b33b6-bf6f-4e54-b647-fc10dff662e3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:26.167527 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1280/2544] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:26 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:43:26.171753 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909f911-b7a2-47e7-b1f1-a700370b7987 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:26.181766 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909f911-b7a2-47e7-b1f1-a700370b7987 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:26.186492 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073292-e556-4a20-9bcf-91be77a97e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:26.187355 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073292-e556-4a20-9bcf-91be77a97e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:26.187632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073292-e556-4a20-9bcf-91be77a97e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:26.187903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073292-e556-4a20-9bcf-91be77a97e7b admin admin] PATH_INFO: `/v3/projects/8dd6c0bb3aea44a3a61bb271d23d17ca/users/faf52c3ca02948f1959504248107ef0c/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:26.189932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3073292-e556-4a20-9bcf-91be77a97e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd6c0bb3aea44a3a61bb271d23d17ca, user_id=faf52c3ca02948f1959504248107ef0c, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:26.192507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3073292-e556-4a20-9bcf-91be77a97e7b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:26.203007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1265/2545] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:26 2021] PUT /identity/v3/projects/8dd6c0bb3aea44a3a61bb271d23d17ca/users/faf52c3ca02948f1959504248107ef0c/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:26.212958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbe845-13c1-4831-9a82-aca4ecbc0c16 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:26.218717 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbe845-13c1-4831-9a82-aca4ecbc0c16 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:26.218717 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbe845-13c1-4831-9a82-aca4ecbc0c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:26.239765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-7dbbe845-13c1-4831-9a82-aca4ecbc0c16 None None] MFA Rules not processed for user `faf52c3ca02948f1959504248107ef0c`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:26.240936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7dbbe845-13c1-4831-9a82-aca4ecbc0c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:26.306368 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1281/2546] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:26 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:43:26.316912 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073292-e556-4a20-9bcf-91be77a97e7b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:26.318582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c3073292-e556-4a20-9bcf-91be77a97e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:26.372404 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073292-e556-4a20-9bcf-91be77a97e7b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:26.376697 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc080625-306f-4631-8f5b-a37a3d787851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:26.377313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc080625-306f-4631-8f5b-a37a3d787851 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:26.377591 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc080625-306f-4631-8f5b-a37a3d787851 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:26.377900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc080625-306f-4631-8f5b-a37a3d787851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:26.386572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc080625-306f-4631-8f5b-a37a3d787851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:26.388010 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc080625-306f-4631-8f5b-a37a3d787851 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:26.398144 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1266/2547] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:26 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:26.605429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbe845-13c1-4831-9a82-aca4ecbc0c16 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:26.614898 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbe845-13c1-4831-9a82-aca4ecbc0c16 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:26.618422 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d332eee-9491-487a-900e-2707b2a5d8dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:26.619056 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d332eee-9491-487a-900e-2707b2a5d8dc service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:26.619336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d332eee-9491-487a-900e-2707b2a5d8dc service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:26.624257 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d332eee-9491-487a-900e-2707b2a5d8dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:26.673447 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d332eee-9491-487a-900e-2707b2a5d8dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:26.674903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d332eee-9491-487a-900e-2707b2a5d8dc service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:26.683525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1282/2548] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:26 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:32.995898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc080625-306f-4631-8f5b-a37a3d787851 service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:33.055939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc080625-306f-4631-8f5b-a37a3d787851 service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:33.060495 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:33.061352 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:33.061637 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:33.061995 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] PATH_INFO: `/v3/users/3e1beae441b14e58a8cc0041f87beaa4` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:33.063254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1beae441b14e58a8cc0041f87beaa4)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:33.065134 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:33.237013 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1beae441b14e58a8cc0041f87beaa4'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:33.237685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1beae441b14e58a8cc0041f87beaa4'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:33.245047 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1beae441b14e58a8cc0041f87beaa4'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:33.320781 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1beae441b14e58a8cc0041f87beaa4'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:33.334223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1beae441b14e58a8cc0041f87beaa4'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:33.340031 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1267/2549] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:43:32 2021] DELETE /identity/v3/users/3e1beae441b14e58a8cc0041f87beaa4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:33.344795 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8b356-14dd-45b2-9782-86bb8446ced1 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:33.345264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8b356-14dd-45b2-9782-86bb8446ced1 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:33.345358 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8b356-14dd-45b2-9782-86bb8446ced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:33.362452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-61a8b356-14dd-45b2-9782-86bb8446ced1 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:33.363624 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-61a8b356-14dd-45b2-9782-86bb8446ced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:33.421760 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1283/2550] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:33.431697 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:33.433076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:33.492328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71ce7c-dbca-4b16-97c5-04bf1b24aeb5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:33.496299 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2055bf3-b61b-4195-a191-c611dd161952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:33.496959 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2055bf3-b61b-4195-a191-c611dd161952 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:33.497237 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2055bf3-b61b-4195-a191-c611dd161952 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:33.497504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2055bf3-b61b-4195-a191-c611dd161952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:33.508626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2055bf3-b61b-4195-a191-c611dd161952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:33.509812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2055bf3-b61b-4195-a191-c611dd161952 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:33.519776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1268/2551] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:33.911325 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8b356-14dd-45b2-9782-86bb8446ced1 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:33.912723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-61a8b356-14dd-45b2-9782-86bb8446ced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:33.927220 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8b356-14dd-45b2-9782-86bb8446ced1 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:33.932311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:33.933182 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:33.933466 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:33.933738 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] PATH_INFO: `/v3/projects/41e4e1e2f6cf468a9a02af94ac22e0bb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:33.935112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e4e1e2f6cf468a9a02af94ac22e0bb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:33.940669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:34.040493 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e4e1e2f6cf468a9a02af94ac22e0bb', 'request_id': 'req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:34.109506 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e4e1e2f6cf468a9a02af94ac22e0bb', 'request_id': 'req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:34.115666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e4e1e2f6cf468a9a02af94ac22e0bb', 'request_id': 'req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:34.127205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] The token cache is being invalidate because project 41e4e1e2f6cf468a9a02af94ac22e0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:43:34.127525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:34.128148 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:34.129664 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1284/2552] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:43:33 2021] DELETE /identity/v3/projects/41e4e1e2f6cf468a9a02af94ac22e0bb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:34.138459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2055bf3-b61b-4195-a191-c611dd161952 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:34.148633 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2055bf3-b61b-4195-a191-c611dd161952 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:34.201021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bba784-ac0d-4722-866e-c94363363503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:34.201895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba784-ac0d-4722-866e-c94363363503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:34.202176 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba784-ac0d-4722-866e-c94363363503 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:34.203086 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bba784-ac0d-4722-866e-c94363363503 admin admin] PATH_INFO: `/v3/users/faf52c3ca02948f1959504248107ef0c` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:34.204309 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bba784-ac0d-4722-866e-c94363363503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf52c3ca02948f1959504248107ef0c)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:34.206275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bba784-ac0d-4722-866e-c94363363503 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:34.413295 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-95bba784-ac0d-4722-866e-c94363363503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf52c3ca02948f1959504248107ef0c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:34.413883 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-95bba784-ac0d-4722-866e-c94363363503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf52c3ca02948f1959504248107ef0c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:34.420376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-95bba784-ac0d-4722-866e-c94363363503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf52c3ca02948f1959504248107ef0c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:34.491905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-95bba784-ac0d-4722-866e-c94363363503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf52c3ca02948f1959504248107ef0c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:34.504148 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-95bba784-ac0d-4722-866e-c94363363503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf52c3ca02948f1959504248107ef0c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:34.509886 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1269/2553] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:43:34 2021] DELETE /identity/v3/users/faf52c3ca02948f1959504248107ef0c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:34.904598 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:34.906563 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:34.919598 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fcf9a-70ad-46e3-b8a4-f10c7c529fc2 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:34.977323 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:34.978217 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:34.978497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:34.978765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47 admin admin] PATH_INFO: `/v3/projects/8dd6c0bb3aea44a3a61bb271d23d17ca` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:34.979930 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd6c0bb3aea44a3a61bb271d23d17ca)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:34.981820 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:35.108883 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd6c0bb3aea44a3a61bb271d23d17ca', 'request_id': 'req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:35.195455 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd6c0bb3aea44a3a61bb271d23d17ca', 'request_id': 'req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:35.201295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd6c0bb3aea44a3a61bb271d23d17ca', 'request_id': 'req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:35.212443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47 admin admin] The token cache is being invalidate because project 8dd6c0bb3aea44a3a61bb271d23d17ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:43:35.212731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:35.213380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-7732eb04-1fb3-4b47-9eb9-ee0d8e60dc47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:35.214955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1285/2554] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:43:34 2021] DELETE /identity/v3/projects/8dd6c0bb3aea44a3a61bb271d23d17ca => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:43:35.220702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32f189-00a4-4ff8-b883-e96eb837ac0f None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:35.222299 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32f189-00a4-4ff8-b883-e96eb837ac0f None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:35.222299 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32f189-00a4-4ff8-b883-e96eb837ac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:35.242866 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-dd32f189-00a4-4ff8-b883-e96eb837ac0f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:35.244087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-dd32f189-00a4-4ff8-b883-e96eb837ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:35.303625 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1270/2555] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:35.315350 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2819a-16f3-42c9-ae20-f2c88e3831ce None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:35.319855 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2819a-16f3-42c9-ae20-f2c88e3831ce None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:35.319855 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2819a-16f3-42c9-ae20-f2c88e3831ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:35.334482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-23a2819a-16f3-42c9-ae20-f2c88e3831ce None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:35.335663 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-23a2819a-16f3-42c9-ae20-f2c88e3831ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:35.344630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1286/2556] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:43:35.349315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32f189-00a4-4ff8-b883-e96eb837ac0f None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:35.360099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32f189-00a4-4ff8-b883-e96eb837ac0f None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:35.364946 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d605-9d80-4751-8550-f8bcd67e23c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:35.365601 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d605-9d80-4751-8550-f8bcd67e23c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:35.365904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d605-9d80-4751-8550-f8bcd67e23c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:35.366183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071d605-9d80-4751-8550-f8bcd67e23c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:35.366899 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071d605-9d80-4751-8550-f8bcd67e23c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:43:35.367202 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071d605-9d80-4751-8550-f8bcd67e23c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:35.368829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071d605-9d80-4751-8550-f8bcd67e23c6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:35.380924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1271/2557] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:43:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:43:35.385277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2819a-16f3-42c9-ae20-f2c88e3831ce None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:35.394753 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2819a-16f3-42c9-ae20-f2c88e3831ce None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:35.399362 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd50d6-1991-4a90-bbbd-9e3579cd9b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:35.400002 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd50d6-1991-4a90-bbbd-9e3579cd9b50 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:35.400277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd50d6-1991-4a90-bbbd-9e3579cd9b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:35.400545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd50d6-1991-4a90-bbbd-9e3579cd9b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:35.401328 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd50d6-1991-4a90-bbbd-9e3579cd9b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:35.403272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd50d6-1991-4a90-bbbd-9e3579cd9b50 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:35.493393 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1287/2558] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:43:35 2021] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:43:35.497638 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d605-9d80-4751-8550-f8bcd67e23c6 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:35.507619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071d605-9d80-4751-8550-f8bcd67e23c6 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:35.562678 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859974f-c5ae-4dd9-aaca-32fd404f019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:35.563341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859974f-c5ae-4dd9-aaca-32fd404f019f admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:35.563619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859974f-c5ae-4dd9-aaca-32fd404f019f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:35.563891 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859974f-c5ae-4dd9-aaca-32fd404f019f admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:35.564562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859974f-c5ae-4dd9-aaca-32fd404f019f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:35.566654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859974f-c5ae-4dd9-aaca-32fd404f019f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:35.661209 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1272/2559] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:43:35 2021] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:35.666887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd50d6-1991-4a90-bbbd-9e3579cd9b50 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:35.676548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd50d6-1991-4a90-bbbd-9e3579cd9b50 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:35.681396 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b77392-bc67-4aa8-b10d-68b3ddeda60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:35.682109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b77392-bc67-4aa8-b10d-68b3ddeda60c admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:35.682390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b77392-bc67-4aa8-b10d-68b3ddeda60c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:35.682669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b77392-bc67-4aa8-b10d-68b3ddeda60c admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:35.683427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b77392-bc67-4aa8-b10d-68b3ddeda60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:35.684994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b77392-bc67-4aa8-b10d-68b3ddeda60c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:35.696076 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1288/2560] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:35.700225 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859974f-c5ae-4dd9-aaca-32fd404f019f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:35.711894 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859974f-c5ae-4dd9-aaca-32fd404f019f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:35.716703 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ed794-c56a-41a8-8b56-510252ba505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:35.717421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ed794-c56a-41a8-8b56-510252ba505e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:35.717711 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ed794-c56a-41a8-8b56-510252ba505e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:35.718661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ed794-c56a-41a8-8b56-510252ba505e admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:35.719393 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ed794-c56a-41a8-8b56-510252ba505e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:35.721008 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ed794-c56a-41a8-8b56-510252ba505e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:35.731312 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1273/2561] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:35.736248 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b77392-bc67-4aa8-b10d-68b3ddeda60c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:35.746167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b77392-bc67-4aa8-b10d-68b3ddeda60c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:35.750836 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42695732-299a-43b7-ae3e-281c2461b98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:35.751701 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42695732-299a-43b7-ae3e-281c2461b98c admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:35.751980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42695732-299a-43b7-ae3e-281c2461b98c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:35.752250 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42695732-299a-43b7-ae3e-281c2461b98c admin admin] PATH_INFO: `/v3/projects/2e5d5459a3ca4c2a928fa2d31ca08ace/users/89d1ff7a02164d6ab875e671a8cb27d4/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:35.767291 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42695732-299a-43b7-ae3e-281c2461b98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5d5459a3ca4c2a928fa2d31ca08ace, user_id=89d1ff7a02164d6ab875e671a8cb27d4, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:35.770167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42695732-299a-43b7-ae3e-281c2461b98c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:35.847423 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1289/2562] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:35 2021] PUT /identity/v3/projects/2e5d5459a3ca4c2a928fa2d31ca08ace/users/89d1ff7a02164d6ab875e671a8cb27d4/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:35.858905 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654839eb-c610-4564-b5f2-10985b9be0cf None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:35.859577 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654839eb-c610-4564-b5f2-10985b9be0cf None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:35.859577 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654839eb-c610-4564-b5f2-10985b9be0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:35.894073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-654839eb-c610-4564-b5f2-10985b9be0cf None None] MFA Rules not processed for user `89d1ff7a02164d6ab875e671a8cb27d4`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:35.895285 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-654839eb-c610-4564-b5f2-10985b9be0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:35.962352 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1274/2563] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:35 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:35.973117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42695732-299a-43b7-ae3e-281c2461b98c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:35.975115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-42695732-299a-43b7-ae3e-281c2461b98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:36.029304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42695732-299a-43b7-ae3e-281c2461b98c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:36.033635 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e10ec4-174b-404c-a01f-08820bfb756a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:36.034313 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e10ec4-174b-404c-a01f-08820bfb756a service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:36.034594 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e10ec4-174b-404c-a01f-08820bfb756a service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:36.034868 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e10ec4-174b-404c-a01f-08820bfb756a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:36.043255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e10ec4-174b-404c-a01f-08820bfb756a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:36.044685 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e10ec4-174b-404c-a01f-08820bfb756a service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:36.053845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1290/2564] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:35 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:36.072722 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654839eb-c610-4564-b5f2-10985b9be0cf None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:36.134791 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654839eb-c610-4564-b5f2-10985b9be0cf None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:36.139679 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:36.141303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:36.141577 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:36.144189 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] PATH_INFO: `/v3/users/89d1ff7a02164d6ab875e671a8cb27d4` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:36.144189 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d1ff7a02164d6ab875e671a8cb27d4)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:36.145183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:36.335185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d1ff7a02164d6ab875e671a8cb27d4'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:36.336349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d1ff7a02164d6ab875e671a8cb27d4'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:36.343152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d1ff7a02164d6ab875e671a8cb27d4'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:36.400899 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d1ff7a02164d6ab875e671a8cb27d4'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:36.414932 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d1ff7a02164d6ab875e671a8cb27d4'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:36.421821 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1275/2565] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:43:36 2021] DELETE /identity/v3/users/89d1ff7a02164d6ab875e671a8cb27d4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:36.426051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea066c7-ed7f-416f-a0cc-22ec5bd44667 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:36.426350 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea066c7-ed7f-416f-a0cc-22ec5bd44667 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:36.426629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea066c7-ed7f-416f-a0cc-22ec5bd44667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:36.447412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-1ea066c7-ed7f-416f-a0cc-22ec5bd44667 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:36.448613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1ea066c7-ed7f-416f-a0cc-22ec5bd44667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:36.513604 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1291/2566] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:36.524538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:36.526143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:36.597816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c813fd-7bab-47eb-a84a-9f3a22abb0c5 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:36.602561 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089311d-17eb-47e8-9823-eefbd0485bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:36.606546 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089311d-17eb-47e8-9823-eefbd0485bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:36.606841 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089311d-17eb-47e8-9823-eefbd0485bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:36.607122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089311d-17eb-47e8-9823-eefbd0485bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:36.625102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089311d-17eb-47e8-9823-eefbd0485bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:36.627842 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089311d-17eb-47e8-9823-eefbd0485bf3 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:36.641255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1276/2567] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:37.083969 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea066c7-ed7f-416f-a0cc-22ec5bd44667 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:37.083969 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1ea066c7-ed7f-416f-a0cc-22ec5bd44667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:37.087380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea066c7-ed7f-416f-a0cc-22ec5bd44667 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:37.092577 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:37.099100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:37.099569 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:37.099857 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66 admin admin] PATH_INFO: `/v3/projects/2e5d5459a3ca4c2a928fa2d31ca08ace` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:37.101213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5d5459a3ca4c2a928fa2d31ca08ace)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:37.103424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:37.232228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5d5459a3ca4c2a928fa2d31ca08ace', 'request_id': 'req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:37.315779 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5d5459a3ca4c2a928fa2d31ca08ace', 'request_id': 'req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:37.322171 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5d5459a3ca4c2a928fa2d31ca08ace', 'request_id': 'req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:37.334217 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66 admin admin] The token cache is being invalidate because project 2e5d5459a3ca4c2a928fa2d31ca08ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:43:37.334441 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:37.335276 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-60991a51-df3b-43bf-ae44-fdd0fb7c2a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:37.336860 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1292/2568] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:43:37 2021] DELETE /identity/v3/projects/2e5d5459a3ca4c2a928fa2d31ca08ace => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:37.344351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a0c5d-778c-4e86-a92f-861d35f2386c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:37.350672 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a0c5d-778c-4e86-a92f-861d35f2386c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:37.350672 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a0c5d-778c-4e86-a92f-861d35f2386c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:37.364268 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-b74a0c5d-778c-4e86-a92f-861d35f2386c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:37.365523 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b74a0c5d-778c-4e86-a92f-861d35f2386c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:37.438818 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1277/2569] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:37.443205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f6037-c184-4480-bdf8-80e4170b57d5 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:37.443604 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f6037-c184-4480-bdf8-80e4170b57d5 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:37.443952 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f6037-c184-4480-bdf8-80e4170b57d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:37.464838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-c31f6037-c184-4480-bdf8-80e4170b57d5 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:37.469309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c31f6037-c184-4480-bdf8-80e4170b57d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:37.474776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1293/2570] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:37.479271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a0c5d-778c-4e86-a92f-861d35f2386c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:37.490076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a0c5d-778c-4e86-a92f-861d35f2386c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:37.495236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b0a56-9358-4cca-b5e4-a5d4c5afbb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:37.495714 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b0a56-9358-4cca-b5e4-a5d4c5afbb1e admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:37.495994 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b0a56-9358-4cca-b5e4-a5d4c5afbb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:37.496267 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b0a56-9358-4cca-b5e4-a5d4c5afbb1e admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:37.497037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b0a56-9358-4cca-b5e4-a5d4c5afbb1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:43:37.497344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b0a56-9358-4cca-b5e4-a5d4c5afbb1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:37.498949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b0a56-9358-4cca-b5e4-a5d4c5afbb1e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:37.511189 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1278/2571] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:43:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:43:37.515785 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f6037-c184-4480-bdf8-80e4170b57d5 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:37.525636 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f6037-c184-4480-bdf8-80e4170b57d5 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:37.534376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3a32f-331c-4635-8027-5e7497ce49b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:37.535172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3a32f-331c-4635-8027-5e7497ce49b7 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:37.535456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3a32f-331c-4635-8027-5e7497ce49b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:37.536494 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3a32f-331c-4635-8027-5e7497ce49b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:37.537172 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3a32f-331c-4635-8027-5e7497ce49b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:37.539811 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3a32f-331c-4635-8027-5e7497ce49b7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:37.637581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1294/2572] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:43:37 2021] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:43:37.642045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b0a56-9358-4cca-b5e4-a5d4c5afbb1e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:37.652127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b0a56-9358-4cca-b5e4-a5d4c5afbb1e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:37.708151 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537877c8-394c-4cb5-83a3-055e3b3c3ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:37.708831 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537877c8-394c-4cb5-83a3-055e3b3c3ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:37.709107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537877c8-394c-4cb5-83a3-055e3b3c3ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:37.709383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537877c8-394c-4cb5-83a3-055e3b3c3ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:37.710091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537877c8-394c-4cb5-83a3-055e3b3c3ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:37.711981 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537877c8-394c-4cb5-83a3-055e3b3c3ee2 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:37.815495 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1279/2573] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:43:37 2021] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:43:37.816802 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3a32f-331c-4635-8027-5e7497ce49b7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:37.827351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3a32f-331c-4635-8027-5e7497ce49b7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:37.832886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e2900-b1be-42f4-ae91-1448607638c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:37.833573 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e2900-b1be-42f4-ae91-1448607638c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:37.833926 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e2900-b1be-42f4-ae91-1448607638c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:37.834207 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e2900-b1be-42f4-ae91-1448607638c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:37.834922 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e2900-b1be-42f4-ae91-1448607638c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:37.836546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e2900-b1be-42f4-ae91-1448607638c8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:37.847157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1295/2574] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:37.857823 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537877c8-394c-4cb5-83a3-055e3b3c3ee2 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:37.868223 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537877c8-394c-4cb5-83a3-055e3b3c3ee2 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:37.872936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a317e6-6c9b-41ca-a4dd-b5d44d3a1721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:37.873674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a317e6-6c9b-41ca-a4dd-b5d44d3a1721 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:37.873991 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a317e6-6c9b-41ca-a4dd-b5d44d3a1721 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:37.874831 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a317e6-6c9b-41ca-a4dd-b5d44d3a1721 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:37.875556 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a317e6-6c9b-41ca-a4dd-b5d44d3a1721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:37.877269 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a317e6-6c9b-41ca-a4dd-b5d44d3a1721 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:37.891681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1280/2575] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:37.892810 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e2900-b1be-42f4-ae91-1448607638c8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:37.902719 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e2900-b1be-42f4-ae91-1448607638c8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:37.907365 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae9300-3030-40c3-873d-a1baa140f47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:37.908232 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae9300-3030-40c3-873d-a1baa140f47a admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:37.908509 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae9300-3030-40c3-873d-a1baa140f47a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:37.908780 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae9300-3030-40c3-873d-a1baa140f47a admin admin] PATH_INFO: `/v3/projects/c3a8f25db2d04f66a1626e322353d6f1/users/1c6a5dc78ec84ce4b1e78dfe27f13697/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:37.922926 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae9300-3030-40c3-873d-a1baa140f47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a8f25db2d04f66a1626e322353d6f1, user_id=1c6a5dc78ec84ce4b1e78dfe27f13697, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:37.925545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae9300-3030-40c3-873d-a1baa140f47a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:38.013577 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1296/2576] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:37 2021] PUT /identity/v3/projects/c3a8f25db2d04f66a1626e322353d6f1/users/1c6a5dc78ec84ce4b1e78dfe27f13697/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:38.024950 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df6af9-1219-4388-abf1-31fbb1f972cf None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:38.025245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df6af9-1219-4388-abf1-31fbb1f972cf None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:38.025649 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df6af9-1219-4388-abf1-31fbb1f972cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:38.054082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-b0df6af9-1219-4388-abf1-31fbb1f972cf None None] MFA Rules not processed for user `1c6a5dc78ec84ce4b1e78dfe27f13697`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:38.055389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b0df6af9-1219-4388-abf1-31fbb1f972cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:38.120973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1281/2577] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:38 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:38.132699 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae9300-3030-40c3-873d-a1baa140f47a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:38.134413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-77ae9300-3030-40c3-873d-a1baa140f47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:38.189815 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae9300-3030-40c3-873d-a1baa140f47a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:38.193480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e3657-b4fe-452d-a345-91b13dab514c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db83070471e34df695b571cdab440b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:38.194153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e3657-b4fe-452d-a345-91b13dab514c service glance] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:38.194434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e3657-b4fe-452d-a345-91b13dab514c service glance] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:38.194710 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e3657-b4fe-452d-a345-91b13dab514c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:38.204123 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e3657-b4fe-452d-a345-91b13dab514c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:38.205567 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e3657-b4fe-452d-a345-91b13dab514c service glance] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:38.215229 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1297/2578] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:38 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:40.463942 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df6af9-1219-4388-abf1-31fbb1f972cf None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:40.465360 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b0df6af9-1219-4388-abf1-31fbb1f972cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:40.522243 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df6af9-1219-4388-abf1-31fbb1f972cf None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:40.526132 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8d37d-bbef-4d9a-9c55-2fd62d8d68e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:40.526838 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8d37d-bbef-4d9a-9c55-2fd62d8d68e2 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:40.527135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8d37d-bbef-4d9a-9c55-2fd62d8d68e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:40.527412 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8d37d-bbef-4d9a-9c55-2fd62d8d68e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:40.529310 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-acf8d37d-bbef-4d9a-9c55-2fd62d8d68e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:40.592896 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8d37d-bbef-4d9a-9c55-2fd62d8d68e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:40.594418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8d37d-bbef-4d9a-9c55-2fd62d8d68e2 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:40.604079 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1282/2579] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:40 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:40.966799 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e3657-b4fe-452d-a345-91b13dab514c service glance] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:40.968213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-398e3657-b4fe-452d-a345-91b13dab514c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:40.981246 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e3657-b4fe-452d-a345-91b13dab514c service glance] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:40.986114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832279b-6b22-416d-a0d0-d15443303819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:40.986978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832279b-6b22-416d-a0d0-d15443303819 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:40.987261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832279b-6b22-416d-a0d0-d15443303819 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:40.987541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832279b-6b22-416d-a0d0-d15443303819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:40.991474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2832279b-6b22-416d-a0d0-d15443303819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:41.057414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832279b-6b22-416d-a0d0-d15443303819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:41.060839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832279b-6b22-416d-a0d0-d15443303819 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:41.073550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1298/2580] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:45.555640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8d37d-bbef-4d9a-9c55-2fd62d8d68e2 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:45.557749 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-acf8d37d-bbef-4d9a-9c55-2fd62d8d68e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:45.586111 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8d37d-bbef-4d9a-9c55-2fd62d8d68e2 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:45.591067 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dfbf8-114c-40cc-b94c-8c6562472036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:45.592027 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dfbf8-114c-40cc-b94c-8c6562472036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:45.592384 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dfbf8-114c-40cc-b94c-8c6562472036 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:45.592661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dfbf8-114c-40cc-b94c-8c6562472036 admin admin] PATH_INFO: `/v3/users/304ebf23ad9c47eeba8baec42e096a2b` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:45.593849 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dfbf8-114c-40cc-b94c-8c6562472036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=304ebf23ad9c47eeba8baec42e096a2b)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:45.596371 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dfbf8-114c-40cc-b94c-8c6562472036 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:45.803371 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-460dfbf8-114c-40cc-b94c-8c6562472036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304ebf23ad9c47eeba8baec42e096a2b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:45.804340 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-460dfbf8-114c-40cc-b94c-8c6562472036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304ebf23ad9c47eeba8baec42e096a2b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:45.811403 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-460dfbf8-114c-40cc-b94c-8c6562472036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304ebf23ad9c47eeba8baec42e096a2b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:45.875240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-460dfbf8-114c-40cc-b94c-8c6562472036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304ebf23ad9c47eeba8baec42e096a2b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:45.888101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-460dfbf8-114c-40cc-b94c-8c6562472036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304ebf23ad9c47eeba8baec42e096a2b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:45.894658 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1283/2581] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:43:45 2021] DELETE /identity/v3/users/304ebf23ad9c47eeba8baec42e096a2b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:46.441039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832279b-6b22-416d-a0d0-d15443303819 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:46.449212 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832279b-6b22-416d-a0d0-d15443303819 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:46.510481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91524175-187b-4036-aafe-cb65ca62a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:46.511355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91524175-187b-4036-aafe-cb65ca62a4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:46.511633 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91524175-187b-4036-aafe-cb65ca62a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:46.511904 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91524175-187b-4036-aafe-cb65ca62a4b8 admin admin] PATH_INFO: `/v3/projects/5afdc403b79a4f7593edca91c2b7f882` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:46.513109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91524175-187b-4036-aafe-cb65ca62a4b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afdc403b79a4f7593edca91c2b7f882)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:46.515114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91524175-187b-4036-aafe-cb65ca62a4b8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:46.618353 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-91524175-187b-4036-aafe-cb65ca62a4b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afdc403b79a4f7593edca91c2b7f882', 'request_id': 'req-91524175-187b-4036-aafe-cb65ca62a4b8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:46.692181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-91524175-187b-4036-aafe-cb65ca62a4b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afdc403b79a4f7593edca91c2b7f882', 'request_id': 'req-91524175-187b-4036-aafe-cb65ca62a4b8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:46.698043 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-91524175-187b-4036-aafe-cb65ca62a4b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afdc403b79a4f7593edca91c2b7f882', 'request_id': 'req-91524175-187b-4036-aafe-cb65ca62a4b8'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:46.747634 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-91524175-187b-4036-aafe-cb65ca62a4b8 admin admin] The token cache is being invalidate because project 5afdc403b79a4f7593edca91c2b7f882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:43:46.747937 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-91524175-187b-4036-aafe-cb65ca62a4b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:46.751721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-91524175-187b-4036-aafe-cb65ca62a4b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:46.762398 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1299/2582] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:43:46 2021] DELETE /identity/v3/projects/5afdc403b79a4f7593edca91c2b7f882 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:46.767936 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64430c0b-a399-44fa-bca9-96c1f33e8ebb None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:46.768973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64430c0b-a399-44fa-bca9-96c1f33e8ebb None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:46.769285 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64430c0b-a399-44fa-bca9-96c1f33e8ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:46.796893 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-64430c0b-a399-44fa-bca9-96c1f33e8ebb None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:46.798496 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-64430c0b-a399-44fa-bca9-96c1f33e8ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:46.884781 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1284/2583] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:46.896254 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e64d8c-bfd3-4509-a69b-e6851e1dbdc6 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:46.896943 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e64d8c-bfd3-4509-a69b-e6851e1dbdc6 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:46.897407 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e64d8c-bfd3-4509-a69b-e6851e1dbdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:46.931196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-05e64d8c-bfd3-4509-a69b-e6851e1dbdc6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:46.937266 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-05e64d8c-bfd3-4509-a69b-e6851e1dbdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:46.955640 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1300/2584] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:46.960297 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64430c0b-a399-44fa-bca9-96c1f33e8ebb None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:46.976543 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64430c0b-a399-44fa-bca9-96c1f33e8ebb None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:46.981845 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfab8db-2212-4ef5-8e12-3e90f4d6b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:46.982966 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfab8db-2212-4ef5-8e12-3e90f4d6b4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:46.983423 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfab8db-2212-4ef5-8e12-3e90f4d6b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:46.983887 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfab8db-2212-4ef5-8e12-3e90f4d6b4e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:46.985587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfab8db-2212-4ef5-8e12-3e90f4d6b4e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:43:46.986108 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfab8db-2212-4ef5-8e12-3e90f4d6b4e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:46.987906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfab8db-2212-4ef5-8e12-3e90f4d6b4e4 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:47.002206 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1285/2585] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:43:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:43:47.007013 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e64d8c-bfd3-4509-a69b-e6851e1dbdc6 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:47.023361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e64d8c-bfd3-4509-a69b-e6851e1dbdc6 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:47.028571 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df7be2-d524-4964-8814-6b64d8142673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:47.029309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df7be2-d524-4964-8814-6b64d8142673 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:47.030049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df7be2-d524-4964-8814-6b64d8142673 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:47.030582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df7be2-d524-4964-8814-6b64d8142673 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:47.031355 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df7be2-d524-4964-8814-6b64d8142673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:47.033606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df7be2-d524-4964-8814-6b64d8142673 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:47.139063 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1301/2586] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:43:47 2021] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:43:47.143226 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfab8db-2212-4ef5-8e12-3e90f4d6b4e4 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:47.153715 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfab8db-2212-4ef5-8e12-3e90f4d6b4e4 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:47.227612 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c04166-a45a-4d03-ac9a-340d9fadf38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:47.228661 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c04166-a45a-4d03-ac9a-340d9fadf38b admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:47.229126 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c04166-a45a-4d03-ac9a-340d9fadf38b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:47.229592 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c04166-a45a-4d03-ac9a-340d9fadf38b admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:47.230459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c04166-a45a-4d03-ac9a-340d9fadf38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:47.235868 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c04166-a45a-4d03-ac9a-340d9fadf38b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:47.334900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1286/2587] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:43:47 2021] POST /identity/v3/users => generated 282 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:47.338153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df7be2-d524-4964-8814-6b64d8142673 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:47.352261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df7be2-d524-4964-8814-6b64d8142673 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:47.359191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8d55b-762c-4310-9d41-9d702250cb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:47.360117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8d55b-762c-4310-9d41-9d702250cb8b admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:47.360117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8d55b-762c-4310-9d41-9d702250cb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:47.360680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8d55b-762c-4310-9d41-9d702250cb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:47.361243 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8d55b-762c-4310-9d41-9d702250cb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:47.362878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8d55b-762c-4310-9d41-9d702250cb8b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:47.374606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1302/2588] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:47 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:47.378929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c04166-a45a-4d03-ac9a-340d9fadf38b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:47.389911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c04166-a45a-4d03-ac9a-340d9fadf38b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:47.395343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4b7f6-e211-40ff-a96e-caabc2cab84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:47.396107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4b7f6-e211-40ff-a96e-caabc2cab84b admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:47.396557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4b7f6-e211-40ff-a96e-caabc2cab84b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:47.397124 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4b7f6-e211-40ff-a96e-caabc2cab84b admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:47.399069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4b7f6-e211-40ff-a96e-caabc2cab84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:47.399826 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4b7f6-e211-40ff-a96e-caabc2cab84b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:47.414128 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1287/2589] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:47 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:43:47.415324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8d55b-762c-4310-9d41-9d702250cb8b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:47.426298 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8d55b-762c-4310-9d41-9d702250cb8b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:47.431384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9aa140-0ba8-4315-87ef-8496f7a0d337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:47.432261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aa140-0ba8-4315-87ef-8496f7a0d337 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:47.432537 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aa140-0ba8-4315-87ef-8496f7a0d337 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:47.432835 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aa140-0ba8-4315-87ef-8496f7a0d337 admin admin] PATH_INFO: `/v3/projects/a0bd168eabc54c2fa26549330a1c64c0/users/69391b00fb00423bb2a73bf2ed6ed8fa/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:47.454856 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9aa140-0ba8-4315-87ef-8496f7a0d337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bd168eabc54c2fa26549330a1c64c0, user_id=69391b00fb00423bb2a73bf2ed6ed8fa, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:47.457519 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9aa140-0ba8-4315-87ef-8496f7a0d337 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:47.538469 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1303/2590] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:47 2021] PUT /identity/v3/projects/a0bd168eabc54c2fa26549330a1c64c0/users/69391b00fb00423bb2a73bf2ed6ed8fa/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:47.550053 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dd1b3-df45-4748-9a18-88ca6e5ee578 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:47.550346 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dd1b3-df45-4748-9a18-88ca6e5ee578 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:47.550624 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dd1b3-df45-4748-9a18-88ca6e5ee578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:47.577326 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-7f7dd1b3-df45-4748-9a18-88ca6e5ee578 None None] MFA Rules not processed for user `69391b00fb00423bb2a73bf2ed6ed8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:47.578611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7f7dd1b3-df45-4748-9a18-88ca6e5ee578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:47.641351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1288/2591] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:47 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:47.646157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9aa140-0ba8-4315-87ef-8496f7a0d337 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:47.707552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9aa140-0ba8-4315-87ef-8496f7a0d337 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:47.712488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f047d5-f698-4048-9429-fe338d7c05a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:47.713303 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f047d5-f698-4048-9429-fe338d7c05a7 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:47.713592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f047d5-f698-4048-9429-fe338d7c05a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:47.713886 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f047d5-f698-4048-9429-fe338d7c05a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:47.714665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f047d5-f698-4048-9429-fe338d7c05a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:47.716697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f047d5-f698-4048-9429-fe338d7c05a7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:47.849050 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1304/2592] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:43:47 2021] POST /identity/v3/projects => generated 365 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:47.853284 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dd1b3-df45-4748-9a18-88ca6e5ee578 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:47.863993 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dd1b3-df45-4748-9a18-88ca6e5ee578 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:47.919823 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a999-ae4e-428a-94ba-8afdb66cf82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:47.920399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a999-ae4e-428a-94ba-8afdb66cf82e admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:47.920686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a999-ae4e-428a-94ba-8afdb66cf82e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:47.920948 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a999-ae4e-428a-94ba-8afdb66cf82e admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:47.921630 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a999-ae4e-428a-94ba-8afdb66cf82e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:47.923601 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a999-ae4e-428a-94ba-8afdb66cf82e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:48.037009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1289/2593] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:43:47 2021] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:48.041041 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f047d5-f698-4048-9429-fe338d7c05a7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:48.051911 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f047d5-f698-4048-9429-fe338d7c05a7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:48.056575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6f54c-4df4-4317-b349-6297d0f471ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:48.057224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6f54c-4df4-4317-b349-6297d0f471ab admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:48.057507 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6f54c-4df4-4317-b349-6297d0f471ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:48.057789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6f54c-4df4-4317-b349-6297d0f471ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:48.058541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6f54c-4df4-4317-b349-6297d0f471ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:48.060175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6f54c-4df4-4317-b349-6297d0f471ab admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:48.071578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1305/2594] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:48.075782 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a999-ae4e-428a-94ba-8afdb66cf82e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:48.087228 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a999-ae4e-428a-94ba-8afdb66cf82e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:48.091864 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a3458-b62b-4f42-b558-3bd201e61dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:48.092742 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a3458-b62b-4f42-b558-3bd201e61dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:48.093024 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a3458-b62b-4f42-b558-3bd201e61dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:48.093300 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a3458-b62b-4f42-b558-3bd201e61dfa admin admin] PATH_INFO: `/v3/projects/e992b15e33c64ca4a6f633ea224ed372/users/9c3b8da927d542e49dbaf900d31409f6/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:48.109171 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a3458-b62b-4f42-b558-3bd201e61dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e992b15e33c64ca4a6f633ea224ed372, user_id=9c3b8da927d542e49dbaf900d31409f6, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:48.111948 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a3458-b62b-4f42-b558-3bd201e61dfa admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:48.248386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1290/2595] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:48 2021] PUT /identity/v3/projects/e992b15e33c64ca4a6f633ea224ed372/users/9c3b8da927d542e49dbaf900d31409f6/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:48.252105 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6f54c-4df4-4317-b349-6297d0f471ab admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:48.262197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6f54c-4df4-4317-b349-6297d0f471ab admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:48.318068 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc6284-2f18-4bfd-96f6-84f601c01356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:48.318746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc6284-2f18-4bfd-96f6-84f601c01356 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:48.319030 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc6284-2f18-4bfd-96f6-84f601c01356 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:48.319308 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc6284-2f18-4bfd-96f6-84f601c01356 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:48.320037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc6284-2f18-4bfd-96f6-84f601c01356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:48.321666 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc6284-2f18-4bfd-96f6-84f601c01356 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:48.332037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1306/2596] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:48 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:48.336453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a3458-b62b-4f42-b558-3bd201e61dfa admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:48.346869 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a3458-b62b-4f42-b558-3bd201e61dfa admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:48.351958 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8ed25-87ce-4d51-a8d4-5a0219195751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:48.352847 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8ed25-87ce-4d51-a8d4-5a0219195751 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:48.355709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8ed25-87ce-4d51-a8d4-5a0219195751 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:48.355709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8ed25-87ce-4d51-a8d4-5a0219195751 admin admin] PATH_INFO: `/v3/projects/e992b15e33c64ca4a6f633ea224ed372/users/9c3b8da927d542e49dbaf900d31409f6/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:48.355709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8ed25-87ce-4d51-a8d4-5a0219195751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e992b15e33c64ca4a6f633ea224ed372, user_id=9c3b8da927d542e49dbaf900d31409f6, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:48.358026 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8ed25-87ce-4d51-a8d4-5a0219195751 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:48.368518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1291/2597] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:48 2021] PUT /identity/v3/projects/e992b15e33c64ca4a6f633ea224ed372/users/9c3b8da927d542e49dbaf900d31409f6/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:48.379475 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768a4d5-4ff5-40fc-93b8-445a2b621794 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:48.380117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768a4d5-4ff5-40fc-93b8-445a2b621794 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:48.380570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768a4d5-4ff5-40fc-93b8-445a2b621794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:48.409473 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d768a4d5-4ff5-40fc-93b8-445a2b621794 None None] MFA Rules not processed for user `9c3b8da927d542e49dbaf900d31409f6`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:48.410729 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d768a4d5-4ff5-40fc-93b8-445a2b621794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:48.479599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1307/2598] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:48 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:48.491096 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8ed25-87ce-4d51-a8d4-5a0219195751 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:48.492949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-88e8ed25-87ce-4d51-a8d4-5a0219195751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:48.552947 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8ed25-87ce-4d51-a8d4-5a0219195751 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:48.556707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41793a-a8c3-43c9-ac8c-120b6c3984cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:48.557350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41793a-a8c3-43c9-ac8c-120b6c3984cd service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:48.557636 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41793a-a8c3-43c9-ac8c-120b6c3984cd service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:48.557944 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41793a-a8c3-43c9-ac8c-120b6c3984cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:48.567629 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41793a-a8c3-43c9-ac8c-120b6c3984cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:48.569051 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41793a-a8c3-43c9-ac8c-120b6c3984cd service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:48.578315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1292/2599] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:48 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:48.796550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768a4d5-4ff5-40fc-93b8-445a2b621794 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:48.807344 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768a4d5-4ff5-40fc-93b8-445a2b621794 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:48.812160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37783347-2952-4a8b-a84c-9d59a525755d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:48.812821 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37783347-2952-4a8b-a84c-9d59a525755d service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:48.813315 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37783347-2952-4a8b-a84c-9d59a525755d service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:48.814360 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37783347-2952-4a8b-a84c-9d59a525755d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:48.870760 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37783347-2952-4a8b-a84c-9d59a525755d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:48.872188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37783347-2952-4a8b-a84c-9d59a525755d service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:48.881140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1308/2600] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:48 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:52.349776 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41793a-a8c3-43c9-ac8c-120b6c3984cd service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:52.408702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41793a-a8c3-43c9-ac8c-120b6c3984cd service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:52.413169 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:52.414028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:52.414306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:52.414575 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] PATH_INFO: `/v3/users/69391b00fb00423bb2a73bf2ed6ed8fa` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:52.415725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69391b00fb00423bb2a73bf2ed6ed8fa)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:52.417582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:52.567530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69391b00fb00423bb2a73bf2ed6ed8fa'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:52.568178 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69391b00fb00423bb2a73bf2ed6ed8fa'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:52.574789 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69391b00fb00423bb2a73bf2ed6ed8fa'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:52.617444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69391b00fb00423bb2a73bf2ed6ed8fa'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:52.630229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69391b00fb00423bb2a73bf2ed6ed8fa'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:52.636810 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1293/2601] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:43:52 2021] DELETE /identity/v3/users/69391b00fb00423bb2a73bf2ed6ed8fa => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:52.641646 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283cf4-0aeb-416d-b735-6359fbab3b61 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:52.642213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283cf4-0aeb-416d-b735-6359fbab3b61 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:52.642418 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283cf4-0aeb-416d-b735-6359fbab3b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:52.661083 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-f3283cf4-0aeb-416d-b735-6359fbab3b61 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:52.662405 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f3283cf4-0aeb-416d-b735-6359fbab3b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:52.734549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1309/2602] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:43:52.745143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:52.746611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:52.805506 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5e673-16c4-472e-9324-5fd2e2562b00 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:52.809210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500058d-deff-4e0e-8962-7d9d90bc6dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:52.809853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500058d-deff-4e0e-8962-7d9d90bc6dcb service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:52.810167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500058d-deff-4e0e-8962-7d9d90bc6dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:52.810445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500058d-deff-4e0e-8962-7d9d90bc6dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:52.819822 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500058d-deff-4e0e-8962-7d9d90bc6dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:52.821173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500058d-deff-4e0e-8962-7d9d90bc6dcb service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:52.831456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1294/2603] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:43:53.237139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3283cf4-0aeb-416d-b735-6359fbab3b61 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:53.238571 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f3283cf4-0aeb-416d-b735-6359fbab3b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:53.250493 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3283cf4-0aeb-416d-b735-6359fbab3b61 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:53.256017 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:53.256935 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:53.257288 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:53.257563 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] PATH_INFO: `/v3/projects/a0bd168eabc54c2fa26549330a1c64c0` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:53.258763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0bd168eabc54c2fa26549330a1c64c0)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:53.260743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:53.361933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0bd168eabc54c2fa26549330a1c64c0', 'request_id': 'req-3113ecca-11e9-438d-8b1a-8a623c5f91dd'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:53.434837 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0bd168eabc54c2fa26549330a1c64c0', 'request_id': 'req-3113ecca-11e9-438d-8b1a-8a623c5f91dd'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:53.440311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0bd168eabc54c2fa26549330a1c64c0', 'request_id': 'req-3113ecca-11e9-438d-8b1a-8a623c5f91dd'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:53.451194 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] The token cache is being invalidate because project a0bd168eabc54c2fa26549330a1c64c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:43:53.451476 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:53.452078 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:53.453642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1310/2604] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:43:53 2021] DELETE /identity/v3/projects/a0bd168eabc54c2fa26549330a1c64c0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:53.458170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500058d-deff-4e0e-8962-7d9d90bc6dcb service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:53.467806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500058d-deff-4e0e-8962-7d9d90bc6dcb service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:53.522210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ce1f8-6957-4341-9be4-05598a6e8aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:53.523067 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ce1f8-6957-4341-9be4-05598a6e8aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:53.523345 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ce1f8-6957-4341-9be4-05598a6e8aad admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:53.523616 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ce1f8-6957-4341-9be4-05598a6e8aad admin admin] PATH_INFO: `/v3/users/9c3b8da927d542e49dbaf900d31409f6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:53.524771 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ce1f8-6957-4341-9be4-05598a6e8aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c3b8da927d542e49dbaf900d31409f6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:53.526685 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ce1f8-6957-4341-9be4-05598a6e8aad admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:53.704674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ae6ce1f8-6957-4341-9be4-05598a6e8aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c3b8da927d542e49dbaf900d31409f6'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:53.705887 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ae6ce1f8-6957-4341-9be4-05598a6e8aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c3b8da927d542e49dbaf900d31409f6'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:53.717640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ae6ce1f8-6957-4341-9be4-05598a6e8aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c3b8da927d542e49dbaf900d31409f6'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:53.793855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ae6ce1f8-6957-4341-9be4-05598a6e8aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c3b8da927d542e49dbaf900d31409f6'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:53.806164 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-ae6ce1f8-6957-4341-9be4-05598a6e8aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c3b8da927d542e49dbaf900d31409f6'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:53.811979 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1295/2605] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:43:53 2021] DELETE /identity/v3/users/9c3b8da927d542e49dbaf900d31409f6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:54.230770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:54.233263 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:54.248143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113ecca-11e9-438d-8b1a-8a623c5f91dd admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:54.303413 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339c26b-c038-4c9e-bfd5-087734592178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:54.304270 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339c26b-c038-4c9e-bfd5-087734592178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:54.304551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339c26b-c038-4c9e-bfd5-087734592178 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:54.304826 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339c26b-c038-4c9e-bfd5-087734592178 admin admin] PATH_INFO: `/v3/projects/e992b15e33c64ca4a6f633ea224ed372` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:54.306031 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339c26b-c038-4c9e-bfd5-087734592178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e992b15e33c64ca4a6f633ea224ed372)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:54.307956 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339c26b-c038-4c9e-bfd5-087734592178 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:54.399948 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4339c26b-c038-4c9e-bfd5-087734592178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e992b15e33c64ca4a6f633ea224ed372', 'request_id': 'req-4339c26b-c038-4c9e-bfd5-087734592178'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:54.469124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4339c26b-c038-4c9e-bfd5-087734592178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e992b15e33c64ca4a6f633ea224ed372', 'request_id': 'req-4339c26b-c038-4c9e-bfd5-087734592178'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:54.475230 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4339c26b-c038-4c9e-bfd5-087734592178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e992b15e33c64ca4a6f633ea224ed372', 'request_id': 'req-4339c26b-c038-4c9e-bfd5-087734592178'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:54.486011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4339c26b-c038-4c9e-bfd5-087734592178 admin admin] The token cache is being invalidate because project e992b15e33c64ca4a6f633ea224ed372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:43:54.486983 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4339c26b-c038-4c9e-bfd5-087734592178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:54.487622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4339c26b-c038-4c9e-bfd5-087734592178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:43:54.489170 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1311/2606] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:43:54 2021] DELETE /identity/v3/projects/e992b15e33c64ca4a6f633ea224ed372 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:54.494898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce66d5-c288-4132-bded-1fc9ecfd36b5 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:54.495366 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce66d5-c288-4132-bded-1fc9ecfd36b5 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:54.495473 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce66d5-c288-4132-bded-1fc9ecfd36b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:54.514107 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-afce66d5-c288-4132-bded-1fc9ecfd36b5 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:54.515291 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-afce66d5-c288-4132-bded-1fc9ecfd36b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:54.570251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1296/2607] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:43:54.578117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ba7d4-f30e-4d95-b74d-6254da5ea8c1 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:54.578410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ba7d4-f30e-4d95-b74d-6254da5ea8c1 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:54.578694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ba7d4-f30e-4d95-b74d-6254da5ea8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:54.597412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-1d1ba7d4-f30e-4d95-b74d-6254da5ea8c1 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:54.598914 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-1d1ba7d4-f30e-4d95-b74d-6254da5ea8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:54.606731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1312/2608] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:54.610799 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce66d5-c288-4132-bded-1fc9ecfd36b5 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:54.621075 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce66d5-c288-4132-bded-1fc9ecfd36b5 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:54.625702 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5cca-f095-4d9b-b60a-b31bc7414896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:54.626384 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5cca-f095-4d9b-b60a-b31bc7414896 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:54.626674 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5cca-f095-4d9b-b60a-b31bc7414896 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:54.628025 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5cca-f095-4d9b-b60a-b31bc7414896 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:54.628759 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d5cca-f095-4d9b-b60a-b31bc7414896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:43:54.629073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d5cca-f095-4d9b-b60a-b31bc7414896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:54.630673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d5cca-f095-4d9b-b60a-b31bc7414896 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:54.641718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1297/2609] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:43:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:43:54.646164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ba7d4-f30e-4d95-b74d-6254da5ea8c1 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:54.655073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ba7d4-f30e-4d95-b74d-6254da5ea8c1 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:54.659921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095103f5-164d-4f74-acaa-88332712b6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:54.660552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095103f5-164d-4f74-acaa-88332712b6ef admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:54.660829 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095103f5-164d-4f74-acaa-88332712b6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:54.661099 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095103f5-164d-4f74-acaa-88332712b6ef admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:54.661765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095103f5-164d-4f74-acaa-88332712b6ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:54.663668 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095103f5-164d-4f74-acaa-88332712b6ef admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:54.744471 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1313/2610] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:43:54 2021] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:43:54.748527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5cca-f095-4d9b-b60a-b31bc7414896 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:54.758942 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5cca-f095-4d9b-b60a-b31bc7414896 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:54.813213 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8135629-370e-47b4-b488-145654b88bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:54.813898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8135629-370e-47b4-b488-145654b88bec admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:54.814172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8135629-370e-47b4-b488-145654b88bec admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:54.814471 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8135629-370e-47b4-b488-145654b88bec admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:54.815156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8135629-370e-47b4-b488-145654b88bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:54.817030 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8135629-370e-47b4-b488-145654b88bec admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:54.932620 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1298/2611] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:43:54 2021] POST /identity/v3/users => generated 301 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:54.936856 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095103f5-164d-4f74-acaa-88332712b6ef admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:54.947205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095103f5-164d-4f74-acaa-88332712b6ef admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:54.952180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da31c-ef40-4a03-9330-51129ff906ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:54.952844 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da31c-ef40-4a03-9330-51129ff906ee admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:54.953129 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da31c-ef40-4a03-9330-51129ff906ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:54.953547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da31c-ef40-4a03-9330-51129ff906ee admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:54.954216 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da31c-ef40-4a03-9330-51129ff906ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:54.962384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da31c-ef40-4a03-9330-51129ff906ee admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:54.966604 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1314/2612] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:54.971356 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8135629-370e-47b4-b488-145654b88bec admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:54.981321 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8135629-370e-47b4-b488-145654b88bec admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:54.985966 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be189f78-8c68-4b0a-a7ae-ebf546df0353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:54.987574 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be189f78-8c68-4b0a-a7ae-ebf546df0353 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:54.987988 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be189f78-8c68-4b0a-a7ae-ebf546df0353 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:54.988397 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be189f78-8c68-4b0a-a7ae-ebf546df0353 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:54.989307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be189f78-8c68-4b0a-a7ae-ebf546df0353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:54.990911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be189f78-8c68-4b0a-a7ae-ebf546df0353 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:55.000635 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1299/2613] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:55.005803 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da31c-ef40-4a03-9330-51129ff906ee admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:55.015617 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da31c-ef40-4a03-9330-51129ff906ee admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:55.020353 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff698a5c-8668-4238-be82-c5b837ec6268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:55.021215 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff698a5c-8668-4238-be82-c5b837ec6268 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:55.021497 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff698a5c-8668-4238-be82-c5b837ec6268 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:55.021770 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff698a5c-8668-4238-be82-c5b837ec6268 admin admin] PATH_INFO: `/v3/projects/0d7f4107b2a54efd9f0d2d4e961fdb1a/users/611c04f0c5ce46628bc4715d2840a99c/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:55.036047 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff698a5c-8668-4238-be82-c5b837ec6268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7f4107b2a54efd9f0d2d4e961fdb1a, user_id=611c04f0c5ce46628bc4715d2840a99c, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:55.038686 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff698a5c-8668-4238-be82-c5b837ec6268 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:55.126966 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1315/2614] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:55 2021] PUT /identity/v3/projects/0d7f4107b2a54efd9f0d2d4e961fdb1a/users/611c04f0c5ce46628bc4715d2840a99c/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:43:55.141954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278fe7-1646-470a-8818-b28c1d7fccc7 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:55.142242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278fe7-1646-470a-8818-b28c1d7fccc7 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:55.142641 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278fe7-1646-470a-8818-b28c1d7fccc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:55.169304 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-80278fe7-1646-470a-8818-b28c1d7fccc7 None None] MFA Rules not processed for user `611c04f0c5ce46628bc4715d2840a99c`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:55.170642 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-80278fe7-1646-470a-8818-b28c1d7fccc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:55.235192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1300/2615] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:55 2021] POST /identity/v3/auth/tokens => generated 3421 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:55.239639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff698a5c-8668-4238-be82-c5b837ec6268 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:55.299133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff698a5c-8668-4238-be82-c5b837ec6268 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:55.303745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9118a-27fa-4d8c-9fec-f864fa4fb211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:55.304386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9118a-27fa-4d8c-9fec-f864fa4fb211 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:55.304665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9118a-27fa-4d8c-9fec-f864fa4fb211 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:55.304932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9118a-27fa-4d8c-9fec-f864fa4fb211 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:55.305606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9118a-27fa-4d8c-9fec-f864fa4fb211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:55.307516 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9118a-27fa-4d8c-9fec-f864fa4fb211 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:55.390207 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1316/2616] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:43:55 2021] POST /identity/v3/projects => generated 401 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:55.394828 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80278fe7-1646-470a-8818-b28c1d7fccc7 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:55.405337 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80278fe7-1646-470a-8818-b28c1d7fccc7 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:55.460529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eb405-26fe-4c36-92f4-84552fbb8821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:55.461199 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eb405-26fe-4c36-92f4-84552fbb8821 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:55.461481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eb405-26fe-4c36-92f4-84552fbb8821 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:55.461812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eb405-26fe-4c36-92f4-84552fbb8821 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:55.462532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eb405-26fe-4c36-92f4-84552fbb8821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:55.464618 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eb405-26fe-4c36-92f4-84552fbb8821 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:55.595293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1301/2617] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:43:55 2021] POST /identity/v3/users => generated 307 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:43:55.599990 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9118a-27fa-4d8c-9fec-f864fa4fb211 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:55.610281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9118a-27fa-4d8c-9fec-f864fa4fb211 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:55.615466 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3c9fc-2f4a-4751-8a85-46363d7fe7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:55.618356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3c9fc-2f4a-4751-8a85-46363d7fe7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:55.618356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3c9fc-2f4a-4751-8a85-46363d7fe7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:55.618356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3c9fc-2f4a-4751-8a85-46363d7fe7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:55.618356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3c9fc-2f4a-4751-8a85-46363d7fe7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:55.619139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3c9fc-2f4a-4751-8a85-46363d7fe7a8 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:55.630084 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1317/2618] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:43:55.633951 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eb405-26fe-4c36-92f4-84552fbb8821 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:55.644588 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eb405-26fe-4c36-92f4-84552fbb8821 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:55.649275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f532768-7e21-4553-b1f5-ad12fed1a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:55.650193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f532768-7e21-4553-b1f5-ad12fed1a39f admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:55.650478 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f532768-7e21-4553-b1f5-ad12fed1a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:55.650755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f532768-7e21-4553-b1f5-ad12fed1a39f admin admin] PATH_INFO: `/v3/projects/055575fe1d8e4cdd899791005e1cd440/users/beb909fd177e40489588c0797ad5d11e/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:55.665235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f532768-7e21-4553-b1f5-ad12fed1a39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=055575fe1d8e4cdd899791005e1cd440, user_id=beb909fd177e40489588c0797ad5d11e, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:55.667949 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f532768-7e21-4553-b1f5-ad12fed1a39f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:55.766404 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1302/2619] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:55 2021] PUT /identity/v3/projects/055575fe1d8e4cdd899791005e1cd440/users/beb909fd177e40489588c0797ad5d11e/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:43:55.771087 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3c9fc-2f4a-4751-8a85-46363d7fe7a8 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:55.780885 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3c9fc-2f4a-4751-8a85-46363d7fe7a8 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:55.835135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4da89-98bd-4107-b9bf-44fc81439b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:55.835794 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4da89-98bd-4107-b9bf-44fc81439b47 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:55.836075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4da89-98bd-4107-b9bf-44fc81439b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:55.836347 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4da89-98bd-4107-b9bf-44fc81439b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:55.837056 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4da89-98bd-4107-b9bf-44fc81439b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:55.838668 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4da89-98bd-4107-b9bf-44fc81439b47 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:55.848568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1318/2620] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:43:55 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:43:55.852587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f532768-7e21-4553-b1f5-ad12fed1a39f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:55.863253 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f532768-7e21-4553-b1f5-ad12fed1a39f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:55.868031 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e320b2c-d9fc-44fa-9bca-d2ab5ea236f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:55.868904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e320b2c-d9fc-44fa-9bca-d2ab5ea236f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:55.869184 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e320b2c-d9fc-44fa-9bca-d2ab5ea236f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:55.869457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e320b2c-d9fc-44fa-9bca-d2ab5ea236f1 admin admin] PATH_INFO: `/v3/projects/055575fe1d8e4cdd899791005e1cd440/users/beb909fd177e40489588c0797ad5d11e/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:55.871424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e320b2c-d9fc-44fa-9bca-d2ab5ea236f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055575fe1d8e4cdd899791005e1cd440, user_id=beb909fd177e40489588c0797ad5d11e, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:55.874039 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e320b2c-d9fc-44fa-9bca-d2ab5ea236f1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:55.884700 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1303/2621] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:43:55 2021] PUT /identity/v3/projects/055575fe1d8e4cdd899791005e1cd440/users/beb909fd177e40489588c0797ad5d11e/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:43:55.895397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b08651-2cfb-4f70-8ee3-3cc7e31a0732 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:55.895686 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b08651-2cfb-4f70-8ee3-3cc7e31a0732 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:55.900119 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b08651-2cfb-4f70-8ee3-3cc7e31a0732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:55.921963 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-90b08651-2cfb-4f70-8ee3-3cc7e31a0732 None None] MFA Rules not processed for user `beb909fd177e40489588c0797ad5d11e`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:43:55.923271 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-90b08651-2cfb-4f70-8ee3-3cc7e31a0732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:55.996097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1319/2622] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:43:55 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:43:56.007810 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e320b2c-d9fc-44fa-9bca-d2ab5ea236f1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:56.009593 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-6e320b2c-d9fc-44fa-9bca-d2ab5ea236f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:56.063847 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e320b2c-d9fc-44fa-9bca-d2ab5ea236f1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:56.068182 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08759b02-4df9-432e-a447-9d92d68f0eee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:56.068814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08759b02-4df9-432e-a447-9d92d68f0eee service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:56.069091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08759b02-4df9-432e-a447-9d92d68f0eee service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:56.069363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08759b02-4df9-432e-a447-9d92d68f0eee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:56.078770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08759b02-4df9-432e-a447-9d92d68f0eee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:56.080197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08759b02-4df9-432e-a447-9d92d68f0eee service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:56.089925 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1304/2623] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:56 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:43:56.324166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b08651-2cfb-4f70-8ee3-3cc7e31a0732 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:43:56.325651 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-90b08651-2cfb-4f70-8ee3-3cc7e31a0732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:43:56.337384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b08651-2cfb-4f70-8ee3-3cc7e31a0732 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:43:56.341070 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5a1c4-ea49-47e9-bb4f-8f4c5f89e906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:43:56.341708 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5a1c4-ea49-47e9-bb4f-8f4c5f89e906 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:43:56.342020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5a1c4-ea49-47e9-bb4f-8f4c5f89e906 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:43:56.342295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5a1c4-ea49-47e9-bb4f-8f4c5f89e906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:43:56.398725 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5a1c4-ea49-47e9-bb4f-8f4c5f89e906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:43:56.400150 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5a1c4-ea49-47e9-bb4f-8f4c5f89e906 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:43:56.409367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1320/2624] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:43:56 2021] GET /identity/v3/auth/tokens => generated 3421 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:03.505344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08759b02-4df9-432e-a447-9d92d68f0eee service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:03.567719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08759b02-4df9-432e-a447-9d92d68f0eee service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:03.573961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:03.574158 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:03.574434 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:03.574705 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] PATH_INFO: `/v3/users/611c04f0c5ce46628bc4715d2840a99c` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:03.576012 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=611c04f0c5ce46628bc4715d2840a99c)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:03.577978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:03.769233 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611c04f0c5ce46628bc4715d2840a99c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:03.769850 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611c04f0c5ce46628bc4715d2840a99c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:03.776652 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611c04f0c5ce46628bc4715d2840a99c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:03.869385 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611c04f0c5ce46628bc4715d2840a99c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:03.881602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611c04f0c5ce46628bc4715d2840a99c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:03.887311 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1305/2625] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:03 2021] DELETE /identity/v3/users/611c04f0c5ce46628bc4715d2840a99c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:03.891797 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa582af-21a8-4693-83a3-eff3e58316dd None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:03.892285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa582af-21a8-4693-83a3-eff3e58316dd None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:03.892380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa582af-21a8-4693-83a3-eff3e58316dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:03.910916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-afa582af-21a8-4693-83a3-eff3e58316dd None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:03.912383 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-afa582af-21a8-4693-83a3-eff3e58316dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:03.970086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1321/2626] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:44:03.980790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:03.982240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:04.037275 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ee3a6-6ad5-4a3d-a557-3744d055bd44 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:04.040827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec10ffb-4b5d-4e3c-8cd6-e1797c2ac898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:04.041464 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec10ffb-4b5d-4e3c-8cd6-e1797c2ac898 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:04.041744 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec10ffb-4b5d-4e3c-8cd6-e1797c2ac898 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:04.042054 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec10ffb-4b5d-4e3c-8cd6-e1797c2ac898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:04.052343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec10ffb-4b5d-4e3c-8cd6-e1797c2ac898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:04.053836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec10ffb-4b5d-4e3c-8cd6-e1797c2ac898 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:04.063802 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1306/2627] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:04.460945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa582af-21a8-4693-83a3-eff3e58316dd None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:04.462842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-afa582af-21a8-4693-83a3-eff3e58316dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:04.477678 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa582af-21a8-4693-83a3-eff3e58316dd None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:04.482746 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:04.483658 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:04.484057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:04.484373 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] PATH_INFO: `/v3/projects/0d7f4107b2a54efd9f0d2d4e961fdb1a` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:04.485682 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7f4107b2a54efd9f0d2d4e961fdb1a)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:04.487639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:04.629086 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7f4107b2a54efd9f0d2d4e961fdb1a', 'request_id': 'req-00f6f58b-6e07-4d95-bb05-8b167fb33159'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:04.720460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7f4107b2a54efd9f0d2d4e961fdb1a', 'request_id': 'req-00f6f58b-6e07-4d95-bb05-8b167fb33159'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:04.726500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7f4107b2a54efd9f0d2d4e961fdb1a', 'request_id': 'req-00f6f58b-6e07-4d95-bb05-8b167fb33159'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:04.737560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] The token cache is being invalidate because project 0d7f4107b2a54efd9f0d2d4e961fdb1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:04.737932 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:04.738547 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:04.740184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1322/2628] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:04 2021] DELETE /identity/v3/projects/0d7f4107b2a54efd9f0d2d4e961fdb1a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:04.744573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec10ffb-4b5d-4e3c-8cd6-e1797c2ac898 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:04.755363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec10ffb-4b5d-4e3c-8cd6-e1797c2ac898 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:04.808343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:04.809297 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:04.809585 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:04.809893 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] PATH_INFO: `/v3/users/beb909fd177e40489588c0797ad5d11e` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:04.811173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb909fd177e40489588c0797ad5d11e)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:04.813265 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:04.985428 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb909fd177e40489588c0797ad5d11e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:04.986098 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb909fd177e40489588c0797ad5d11e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:04.993196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb909fd177e40489588c0797ad5d11e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:05.061495 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:05.062943 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:05.070089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb909fd177e40489588c0797ad5d11e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:05.082549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb909fd177e40489588c0797ad5d11e'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:05.088847 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1307/2629] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:04 2021] DELETE /identity/v3/users/beb909fd177e40489588c0797ad5d11e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:44:05.135466 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6f58b-6e07-4d95-bb05-8b167fb33159 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:05.196118 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffae18-7a6d-4606-ad2e-849c3818539d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77a408df11844e2aacbb366019dc3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:05.196763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffae18-7a6d-4606-ad2e-849c3818539d service placement] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:05.197046 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffae18-7a6d-4606-ad2e-849c3818539d service placement] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:05.197321 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffae18-7a6d-4606-ad2e-849c3818539d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:05.199193 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-82ffae18-7a6d-4606-ad2e-849c3818539d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:05.210919 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffae18-7a6d-4606-ad2e-849c3818539d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:05.212496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffae18-7a6d-4606-ad2e-849c3818539d service placement] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:05.222758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1323/2630] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:05 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:44:05.543957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:05.545425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:05.612061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998bbbf-2326-436e-91dd-89bb4d11c184 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:05.617596 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f3938-0849-4d29-b8d1-781c548983e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:05.618558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f3938-0849-4d29-b8d1-781c548983e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:05.618832 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f3938-0849-4d29-b8d1-781c548983e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:05.619098 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f3938-0849-4d29-b8d1-781c548983e1 admin admin] PATH_INFO: `/v3/projects/055575fe1d8e4cdd899791005e1cd440` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:05.620291 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f3938-0849-4d29-b8d1-781c548983e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055575fe1d8e4cdd899791005e1cd440)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:05.622350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f3938-0849-4d29-b8d1-781c548983e1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:05.744961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-160f3938-0849-4d29-b8d1-781c548983e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055575fe1d8e4cdd899791005e1cd440', 'request_id': 'req-160f3938-0849-4d29-b8d1-781c548983e1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:05.822660 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-160f3938-0849-4d29-b8d1-781c548983e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055575fe1d8e4cdd899791005e1cd440', 'request_id': 'req-160f3938-0849-4d29-b8d1-781c548983e1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:05.828557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-160f3938-0849-4d29-b8d1-781c548983e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055575fe1d8e4cdd899791005e1cd440', 'request_id': 'req-160f3938-0849-4d29-b8d1-781c548983e1'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:05.840418 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-160f3938-0849-4d29-b8d1-781c548983e1 admin admin] The token cache is being invalidate because project 055575fe1d8e4cdd899791005e1cd440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:05.840698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-160f3938-0849-4d29-b8d1-781c548983e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:05.841585 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-160f3938-0849-4d29-b8d1-781c548983e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:05.843184 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1308/2631] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:05 2021] DELETE /identity/v3/projects/055575fe1d8e4cdd899791005e1cd440 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:05.849804 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147de14-92fd-4474-be73-58f193ef8e2f None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:05.850127 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147de14-92fd-4474-be73-58f193ef8e2f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:05.850427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147de14-92fd-4474-be73-58f193ef8e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:05.867334 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3147de14-92fd-4474-be73-58f193ef8e2f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:05.868505 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3147de14-92fd-4474-be73-58f193ef8e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:05.926480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1324/2632] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:44:05.934204 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5246a-ca0f-4b41-8d0c-a7439be77d80 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:05.934562 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5246a-ca0f-4b41-8d0c-a7439be77d80 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:05.934902 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5246a-ca0f-4b41-8d0c-a7439be77d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:05.952808 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-78d5246a-ca0f-4b41-8d0c-a7439be77d80 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:05.954274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-78d5246a-ca0f-4b41-8d0c-a7439be77d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:05.963048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1309/2633] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:05.967197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147de14-92fd-4474-be73-58f193ef8e2f None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:05.977673 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147de14-92fd-4474-be73-58f193ef8e2f None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:05.982235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b31bb7-d3db-47e6-b086-cd173d86413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:05.982890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b31bb7-d3db-47e6-b086-cd173d86413d admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:05.983160 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b31bb7-d3db-47e6-b086-cd173d86413d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:05.983434 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b31bb7-d3db-47e6-b086-cd173d86413d admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:05.984146 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b31bb7-d3db-47e6-b086-cd173d86413d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:44:05.984452 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b31bb7-d3db-47e6-b086-cd173d86413d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:05.986057 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b31bb7-d3db-47e6-b086-cd173d86413d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:05.997469 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1325/2634] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:44:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:44:06.001617 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5246a-ca0f-4b41-8d0c-a7439be77d80 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:06.011509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5246a-ca0f-4b41-8d0c-a7439be77d80 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:06.016128 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66760068-297a-4558-8ba5-34badb31413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:06.016767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66760068-297a-4558-8ba5-34badb31413f admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:06.017044 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66760068-297a-4558-8ba5-34badb31413f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:06.017314 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66760068-297a-4558-8ba5-34badb31413f admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:06.018028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66760068-297a-4558-8ba5-34badb31413f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:06.020668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66760068-297a-4558-8ba5-34badb31413f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:06.093045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1310/2635] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:44:06 2021] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:06.097267 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b31bb7-d3db-47e6-b086-cd173d86413d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:06.108589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b31bb7-d3db-47e6-b086-cd173d86413d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:06.166511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8c34a-de89-4d63-b86e-e495f29abd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:06.167175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8c34a-de89-4d63-b86e-e495f29abd4c admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:06.167458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8c34a-de89-4d63-b86e-e495f29abd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:06.167733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8c34a-de89-4d63-b86e-e495f29abd4c admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:06.168550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8c34a-de89-4d63-b86e-e495f29abd4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:06.170611 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8c34a-de89-4d63-b86e-e495f29abd4c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:06.228862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1326/2636] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:44:06 2021] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:06.232959 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66760068-297a-4558-8ba5-34badb31413f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:06.243450 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66760068-297a-4558-8ba5-34badb31413f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:06.248102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2ba40-b71b-4d2b-8f73-871c9322373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:06.248694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2ba40-b71b-4d2b-8f73-871c9322373a admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:06.248978 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2ba40-b71b-4d2b-8f73-871c9322373a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:06.249254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2ba40-b71b-4d2b-8f73-871c9322373a admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:06.250023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2ba40-b71b-4d2b-8f73-871c9322373a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:06.251629 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2ba40-b71b-4d2b-8f73-871c9322373a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:06.264815 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1311/2637] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:06.270266 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8c34a-de89-4d63-b86e-e495f29abd4c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:06.280526 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8c34a-de89-4d63-b86e-e495f29abd4c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:06.285816 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6f035-0500-4b2e-88dc-a17b463865f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:06.286602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6f035-0500-4b2e-88dc-a17b463865f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:06.286901 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6f035-0500-4b2e-88dc-a17b463865f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:06.287184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6f035-0500-4b2e-88dc-a17b463865f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:06.287923 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6f035-0500-4b2e-88dc-a17b463865f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:06.289494 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6f035-0500-4b2e-88dc-a17b463865f2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:06.300106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1327/2638] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:06.304390 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2ba40-b71b-4d2b-8f73-871c9322373a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:06.317738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2ba40-b71b-4d2b-8f73-871c9322373a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:06.322450 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f11226-7e9b-466d-bc71-d62969e6e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:06.323354 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f11226-7e9b-466d-bc71-d62969e6e820 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:06.323632 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f11226-7e9b-466d-bc71-d62969e6e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:06.323907 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f11226-7e9b-466d-bc71-d62969e6e820 admin admin] PATH_INFO: `/v3/projects/f9c575fd32434e03bfc3d9615822a8db/users/ba06ea7368f14461a5f576ce3fb31adc/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:06.338737 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f11226-7e9b-466d-bc71-d62969e6e820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c575fd32434e03bfc3d9615822a8db, user_id=ba06ea7368f14461a5f576ce3fb31adc, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:06.341352 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f11226-7e9b-466d-bc71-d62969e6e820 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:06.446875 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1312/2639] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:06 2021] PUT /identity/v3/projects/f9c575fd32434e03bfc3d9615822a8db/users/ba06ea7368f14461a5f576ce3fb31adc/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:06.458252 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b9ecd-e764-42e3-8382-04cb9c3a79e8 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:06.458590 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b9ecd-e764-42e3-8382-04cb9c3a79e8 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:06.458870 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b9ecd-e764-42e3-8382-04cb9c3a79e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:06.484882 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-9f9b9ecd-e764-42e3-8382-04cb9c3a79e8 None None] MFA Rules not processed for user `ba06ea7368f14461a5f576ce3fb31adc`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:06.486112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-9f9b9ecd-e764-42e3-8382-04cb9c3a79e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:06.548364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1328/2640] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:06 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:06.553646 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f11226-7e9b-466d-bc71-d62969e6e820 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:06.612445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f11226-7e9b-466d-bc71-d62969e6e820 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:06.617570 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477560aa-218d-465c-8ae5-84d30bb23074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:06.618250 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477560aa-218d-465c-8ae5-84d30bb23074 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:06.618529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477560aa-218d-465c-8ae5-84d30bb23074 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:06.618796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477560aa-218d-465c-8ae5-84d30bb23074 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:06.619475 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477560aa-218d-465c-8ae5-84d30bb23074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:06.621333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477560aa-218d-465c-8ae5-84d30bb23074 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:06.737219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1313/2641] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:44:06 2021] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:44:06.739372 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b9ecd-e764-42e3-8382-04cb9c3a79e8 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:06.750581 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b9ecd-e764-42e3-8382-04cb9c3a79e8 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:06.809514 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f767ab1-dbab-4e4c-9dc7-50e802dd9c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:06.810227 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f767ab1-dbab-4e4c-9dc7-50e802dd9c00 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:06.810502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f767ab1-dbab-4e4c-9dc7-50e802dd9c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:06.810771 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f767ab1-dbab-4e4c-9dc7-50e802dd9c00 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:06.811527 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f767ab1-dbab-4e4c-9dc7-50e802dd9c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:06.813425 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f767ab1-dbab-4e4c-9dc7-50e802dd9c00 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:06.886607 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1329/2642] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:44:06 2021] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:44:06.889686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477560aa-218d-465c-8ae5-84d30bb23074 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:06.899833 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477560aa-218d-465c-8ae5-84d30bb23074 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:06.904448 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330d739-ff55-487d-8dc9-9960c2769681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:06.905099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330d739-ff55-487d-8dc9-9960c2769681 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:06.905380 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330d739-ff55-487d-8dc9-9960c2769681 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:06.908513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330d739-ff55-487d-8dc9-9960c2769681 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:06.908513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330d739-ff55-487d-8dc9-9960c2769681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:06.908513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330d739-ff55-487d-8dc9-9960c2769681 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:06.918684 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1314/2643] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:06.922774 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f767ab1-dbab-4e4c-9dc7-50e802dd9c00 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:06.933648 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f767ab1-dbab-4e4c-9dc7-50e802dd9c00 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:06.938404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf50f7-e187-47c7-91e7-bd4ca2ed34ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:06.939302 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf50f7-e187-47c7-91e7-bd4ca2ed34ab admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:06.939579 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf50f7-e187-47c7-91e7-bd4ca2ed34ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:06.939848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf50f7-e187-47c7-91e7-bd4ca2ed34ab admin admin] PATH_INFO: `/v3/projects/b09ed877d7934f17883ebaeccfc90388/users/cec1eebdb9b1487da746ef90b5068332/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:06.958482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf50f7-e187-47c7-91e7-bd4ca2ed34ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09ed877d7934f17883ebaeccfc90388, user_id=cec1eebdb9b1487da746ef90b5068332, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:06.961267 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf50f7-e187-47c7-91e7-bd4ca2ed34ab admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:07.034319 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1330/2644] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:06 2021] PUT /identity/v3/projects/b09ed877d7934f17883ebaeccfc90388/users/cec1eebdb9b1487da746ef90b5068332/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:07.038826 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330d739-ff55-487d-8dc9-9960c2769681 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:07.048456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330d739-ff55-487d-8dc9-9960c2769681 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:07.103872 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936cdcb-d507-44dd-bb1f-bea1d32f7ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:07.104721 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936cdcb-d507-44dd-bb1f-bea1d32f7ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:07.105048 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936cdcb-d507-44dd-bb1f-bea1d32f7ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:07.105377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936cdcb-d507-44dd-bb1f-bea1d32f7ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:07.106120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936cdcb-d507-44dd-bb1f-bea1d32f7ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:07.108143 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936cdcb-d507-44dd-bb1f-bea1d32f7ef0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:07.118261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1315/2645] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:07 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:44:07.122599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf50f7-e187-47c7-91e7-bd4ca2ed34ab admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:07.133201 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf50f7-e187-47c7-91e7-bd4ca2ed34ab admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:07.137852 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82169059-06da-472d-b48c-fea2d04e2d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:07.142593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82169059-06da-472d-b48c-fea2d04e2d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:07.142593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82169059-06da-472d-b48c-fea2d04e2d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:07.142593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82169059-06da-472d-b48c-fea2d04e2d7c admin admin] PATH_INFO: `/v3/projects/b09ed877d7934f17883ebaeccfc90388/users/cec1eebdb9b1487da746ef90b5068332/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:07.142593 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82169059-06da-472d-b48c-fea2d04e2d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09ed877d7934f17883ebaeccfc90388, user_id=cec1eebdb9b1487da746ef90b5068332, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:07.144601 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82169059-06da-472d-b48c-fea2d04e2d7c admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:07.154563 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1331/2646] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:07 2021] PUT /identity/v3/projects/b09ed877d7934f17883ebaeccfc90388/users/cec1eebdb9b1487da746ef90b5068332/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:07.164887 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c726-b477-495b-8802-622f96acf708 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:07.165179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c726-b477-495b-8802-622f96acf708 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:07.165485 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c726-b477-495b-8802-622f96acf708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:07.191292 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-9f43c726-b477-495b-8802-622f96acf708 None None] MFA Rules not processed for user `cec1eebdb9b1487da746ef90b5068332`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:07.192516 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-9f43c726-b477-495b-8802-622f96acf708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:07.256790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1316/2647] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:07 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:07.266485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82169059-06da-472d-b48c-fea2d04e2d7c admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:07.268188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-82169059-06da-472d-b48c-fea2d04e2d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:07.323588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82169059-06da-472d-b48c-fea2d04e2d7c admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:07.328064 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fec424-023c-4071-abd6-f33a6b855571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:07.328709 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fec424-023c-4071-abd6-f33a6b855571 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:07.328987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fec424-023c-4071-abd6-f33a6b855571 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:07.329256 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fec424-023c-4071-abd6-f33a6b855571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:07.339485 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fec424-023c-4071-abd6-f33a6b855571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:07.340945 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fec424-023c-4071-abd6-f33a6b855571 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:07.351133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1332/2648] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:07 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:07.441231 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43c726-b477-495b-8802-622f96acf708 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:07.450738 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43c726-b477-495b-8802-622f96acf708 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:07.454502 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5360152-177a-4968-9ec0-f8bb22996d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:07.455133 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360152-177a-4968-9ec0-f8bb22996d7e service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:07.455414 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360152-177a-4968-9ec0-f8bb22996d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:07.455687 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360152-177a-4968-9ec0-f8bb22996d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:07.511827 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5360152-177a-4968-9ec0-f8bb22996d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:07.513302 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5360152-177a-4968-9ec0-f8bb22996d7e service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:07.523173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1317/2649] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:07 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:08.584569 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fec424-023c-4071-abd6-f33a6b855571 service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:08.585976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-54fec424-023c-4071-abd6-f33a6b855571 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:08.652139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fec424-023c-4071-abd6-f33a6b855571 service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:08.656724 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:08.657578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:08.657856 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:08.658156 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] PATH_INFO: `/v3/users/1c6a5dc78ec84ce4b1e78dfe27f13697` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:08.659314 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6a5dc78ec84ce4b1e78dfe27f13697)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:08.661347 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:08.876365 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6a5dc78ec84ce4b1e78dfe27f13697'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:08.876963 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6a5dc78ec84ce4b1e78dfe27f13697'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:08.877562 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6a5dc78ec84ce4b1e78dfe27f13697'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:08.949143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6a5dc78ec84ce4b1e78dfe27f13697'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:08.963867 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6a5dc78ec84ce4b1e78dfe27f13697'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:08.975954 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1333/2650] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:08 2021] DELETE /identity/v3/users/1c6a5dc78ec84ce4b1e78dfe27f13697 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:08.980598 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d541f8-2f9a-42fa-97aa-3f0f4d9a21fa None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:08.983263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d541f8-2f9a-42fa-97aa-3f0f4d9a21fa None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:08.983263 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d541f8-2f9a-42fa-97aa-3f0f4d9a21fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:08.999496 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-86d541f8-2f9a-42fa-97aa-3f0f4d9a21fa None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:09.000713 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-86d541f8-2f9a-42fa-97aa-3f0f4d9a21fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:09.056803 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1318/2651] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:09.066545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:09.067972 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:09.126232 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973751c1-472f-42be-8d7c-9ba8dc87a99d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:09.129889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e5c58-d3aa-4bd8-ad8e-c10bb059dcdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:09.131259 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e5c58-d3aa-4bd8-ad8e-c10bb059dcdd service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:09.131548 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e5c58-d3aa-4bd8-ad8e-c10bb059dcdd service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:09.131832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e5c58-d3aa-4bd8-ad8e-c10bb059dcdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:09.141111 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e5c58-d3aa-4bd8-ad8e-c10bb059dcdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:09.142605 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e5c58-d3aa-4bd8-ad8e-c10bb059dcdd service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:09.152144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1334/2652] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:44:09.580037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d541f8-2f9a-42fa-97aa-3f0f4d9a21fa None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:09.583482 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-86d541f8-2f9a-42fa-97aa-3f0f4d9a21fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:09.595469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d541f8-2f9a-42fa-97aa-3f0f4d9a21fa None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:09.601456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dde32-4f15-47d9-8959-0b4990ede85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:09.602384 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dde32-4f15-47d9-8959-0b4990ede85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:09.602669 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dde32-4f15-47d9-8959-0b4990ede85c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:09.602945 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dde32-4f15-47d9-8959-0b4990ede85c admin admin] PATH_INFO: `/v3/projects/c3a8f25db2d04f66a1626e322353d6f1` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:09.604132 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dde32-4f15-47d9-8959-0b4990ede85c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a8f25db2d04f66a1626e322353d6f1)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:09.606102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dde32-4f15-47d9-8959-0b4990ede85c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:09.702844 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0c3dde32-4f15-47d9-8959-0b4990ede85c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a8f25db2d04f66a1626e322353d6f1', 'request_id': 'req-0c3dde32-4f15-47d9-8959-0b4990ede85c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:09.794772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0c3dde32-4f15-47d9-8959-0b4990ede85c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a8f25db2d04f66a1626e322353d6f1', 'request_id': 'req-0c3dde32-4f15-47d9-8959-0b4990ede85c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:09.800708 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0c3dde32-4f15-47d9-8959-0b4990ede85c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a8f25db2d04f66a1626e322353d6f1', 'request_id': 'req-0c3dde32-4f15-47d9-8959-0b4990ede85c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:09.811785 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0c3dde32-4f15-47d9-8959-0b4990ede85c admin admin] The token cache is being invalidate because project c3a8f25db2d04f66a1626e322353d6f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:09.812099 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0c3dde32-4f15-47d9-8959-0b4990ede85c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:09.812683 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-0c3dde32-4f15-47d9-8959-0b4990ede85c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:09.814229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1319/2653] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:09 2021] DELETE /identity/v3/projects/c3a8f25db2d04f66a1626e322353d6f1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:09.820492 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ced12-5023-4001-95ca-851f23c5fe69 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:09.820965 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ced12-5023-4001-95ca-851f23c5fe69 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:09.821082 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ced12-5023-4001-95ca-851f23c5fe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:09.839097 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-2e1ced12-5023-4001-95ca-851f23c5fe69 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:09.840350 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2e1ced12-5023-4001-95ca-851f23c5fe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:09.897642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1335/2654] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:09.905601 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b0852-1c91-4328-a4ee-84e7213f556d None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:09.905953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b0852-1c91-4328-a4ee-84e7213f556d None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:09.906180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b0852-1c91-4328-a4ee-84e7213f556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:09.923961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-f75b0852-1c91-4328-a4ee-84e7213f556d None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:09.925170 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-f75b0852-1c91-4328-a4ee-84e7213f556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:09.933076 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1320/2655] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:44:09.937491 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ced12-5023-4001-95ca-851f23c5fe69 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:09.947890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ced12-5023-4001-95ca-851f23c5fe69 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:09.954588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b8f39-d738-408b-a151-9630d2675f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:09.954588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b8f39-d738-408b-a151-9630d2675f58 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:09.954588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b8f39-d738-408b-a151-9630d2675f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:09.954588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b8f39-d738-408b-a151-9630d2675f58 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:09.955012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b8f39-d738-408b-a151-9630d2675f58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:44:09.955012 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b8f39-d738-408b-a151-9630d2675f58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:09.959140 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b8f39-d738-408b-a151-9630d2675f58 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:09.983386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1336/2656] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:44:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:44:09.988260 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b0852-1c91-4328-a4ee-84e7213f556d None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:09.997317 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b0852-1c91-4328-a4ee-84e7213f556d None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:10.002159 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469bc4a-6479-47bd-8071-c310a4ee6e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:10.002799 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469bc4a-6479-47bd-8071-c310a4ee6e61 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:10.003078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469bc4a-6479-47bd-8071-c310a4ee6e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:10.003939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469bc4a-6479-47bd-8071-c310a4ee6e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:10.004626 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469bc4a-6479-47bd-8071-c310a4ee6e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:10.006538 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469bc4a-6479-47bd-8071-c310a4ee6e61 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:10.166807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1321/2657] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:44:09 2021] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:44:10.170944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b8f39-d738-408b-a151-9630d2675f58 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:10.181978 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b8f39-d738-408b-a151-9630d2675f58 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:10.235991 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de9fa7-1854-4fd7-8f34-274fd2acb3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:10.236585 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de9fa7-1854-4fd7-8f34-274fd2acb3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:10.236867 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de9fa7-1854-4fd7-8f34-274fd2acb3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:10.237162 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de9fa7-1854-4fd7-8f34-274fd2acb3f4 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:10.238535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de9fa7-1854-4fd7-8f34-274fd2acb3f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:10.240472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de9fa7-1854-4fd7-8f34-274fd2acb3f4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:10.350441 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1337/2658] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:44:10 2021] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:44:10.354424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469bc4a-6479-47bd-8071-c310a4ee6e61 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:10.364700 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469bc4a-6479-47bd-8071-c310a4ee6e61 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:10.369389 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749bf7f-4f09-405d-98dd-d3b888539fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:10.370078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749bf7f-4f09-405d-98dd-d3b888539fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:10.370386 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749bf7f-4f09-405d-98dd-d3b888539fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:10.370659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749bf7f-4f09-405d-98dd-d3b888539fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:10.371382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749bf7f-4f09-405d-98dd-d3b888539fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:10.372960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749bf7f-4f09-405d-98dd-d3b888539fa6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:10.384444 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1322/2659] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:10 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:10.388298 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de9fa7-1854-4fd7-8f34-274fd2acb3f4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:10.398747 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de9fa7-1854-4fd7-8f34-274fd2acb3f4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:10.403346 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212624c9-9734-4ba3-a98d-d9b9046162a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:10.404006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212624c9-9734-4ba3-a98d-d9b9046162a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:10.404285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212624c9-9734-4ba3-a98d-d9b9046162a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:10.404560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212624c9-9734-4ba3-a98d-d9b9046162a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:10.405275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212624c9-9734-4ba3-a98d-d9b9046162a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:10.406895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212624c9-9734-4ba3-a98d-d9b9046162a2 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:10.421109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1338/2660] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:10.422397 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749bf7f-4f09-405d-98dd-d3b888539fa6 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:10.432294 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749bf7f-4f09-405d-98dd-d3b888539fa6 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:10.436919 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349bbf9-73d0-48bd-aed3-d897d55cea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:10.437792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349bbf9-73d0-48bd-aed3-d897d55cea2e admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:10.438101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349bbf9-73d0-48bd-aed3-d897d55cea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:10.438377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349bbf9-73d0-48bd-aed3-d897d55cea2e admin admin] PATH_INFO: `/v3/projects/e20fbc7614fb4be3a3c041d96abe2ad2/users/79a50b7b83674f459dd2bc8db577fb29/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:10.452911 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349bbf9-73d0-48bd-aed3-d897d55cea2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20fbc7614fb4be3a3c041d96abe2ad2, user_id=79a50b7b83674f459dd2bc8db577fb29, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:10.455569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349bbf9-73d0-48bd-aed3-d897d55cea2e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:10.543183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1323/2661] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:10 2021] PUT /identity/v3/projects/e20fbc7614fb4be3a3c041d96abe2ad2/users/79a50b7b83674f459dd2bc8db577fb29/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:10.553183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdc243-65e9-4cd1-bb3e-87f01859cf85 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:10.553574 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdc243-65e9-4cd1-bb3e-87f01859cf85 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:10.553857 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdc243-65e9-4cd1-bb3e-87f01859cf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:10.579745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-7fcdc243-65e9-4cd1-bb3e-87f01859cf85 None None] MFA Rules not processed for user `79a50b7b83674f459dd2bc8db577fb29`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:10.580957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7fcdc243-65e9-4cd1-bb3e-87f01859cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:10.605621 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349bbf9-73d0-48bd-aed3-d897d55cea2e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:10.607349 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-2349bbf9-73d0-48bd-aed3-d897d55cea2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:10.649052 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1339/2662] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:10 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:10.658608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdc243-65e9-4cd1-bb3e-87f01859cf85 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:10.659933 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7fcdc243-65e9-4cd1-bb3e-87f01859cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:10.669607 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349bbf9-73d0-48bd-aed3-d897d55cea2e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:10.674282 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:10.675266 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:10.675649 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:10.675923 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] PATH_INFO: `/v3/users/ba06ea7368f14461a5f576ce3fb31adc` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:10.677255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba06ea7368f14461a5f576ce3fb31adc)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:10.679073 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:10.716205 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdc243-65e9-4cd1-bb3e-87f01859cf85 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:10.719994 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c4ad2-a6be-4b7e-bc1d-27316e3af01c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:10.720632 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c4ad2-a6be-4b7e-bc1d-27316e3af01c service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:10.720908 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c4ad2-a6be-4b7e-bc1d-27316e3af01c service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:10.721177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c4ad2-a6be-4b7e-bc1d-27316e3af01c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:10.729980 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c4ad2-a6be-4b7e-bc1d-27316e3af01c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:10.731444 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c4ad2-a6be-4b7e-bc1d-27316e3af01c service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:10.740166 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1340/2663] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:10 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:44:10.860924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba06ea7368f14461a5f576ce3fb31adc'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:10.861615 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba06ea7368f14461a5f576ce3fb31adc'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:10.869133 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba06ea7368f14461a5f576ce3fb31adc'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:10.920594 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba06ea7368f14461a5f576ce3fb31adc'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:10.934078 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba06ea7368f14461a5f576ce3fb31adc'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:10.940100 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1324/2664] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:10 2021] DELETE /identity/v3/users/ba06ea7368f14461a5f576ce3fb31adc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:44:10.945197 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f38c9a-d8b0-4f98-a2f2-68a7627f273f None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:10.945654 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f38c9a-d8b0-4f98-a2f2-68a7627f273f None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:10.945941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f38c9a-d8b0-4f98-a2f2-68a7627f273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:10.962546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-95f38c9a-d8b0-4f98-a2f2-68a7627f273f None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:10.963842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-95f38c9a-d8b0-4f98-a2f2-68a7627f273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:11.021352 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1341/2665] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:11.031288 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:11.032666 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:11.089470 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba56a9-0c0b-4ad7-a3b6-8eb58d9edb24 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:11.093155 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f89db-835c-468a-90ec-83a8b472aa25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:11.093796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f89db-835c-468a-90ec-83a8b472aa25 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:11.094106 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f89db-835c-468a-90ec-83a8b472aa25 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:11.094382 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f89db-835c-468a-90ec-83a8b472aa25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:11.107056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f89db-835c-468a-90ec-83a8b472aa25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:11.108718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f89db-835c-468a-90ec-83a8b472aa25 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:11.119183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1325/2666] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:11.504768 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f38c9a-d8b0-4f98-a2f2-68a7627f273f None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:11.506168 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-95f38c9a-d8b0-4f98-a2f2-68a7627f273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:11.517625 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f38c9a-d8b0-4f98-a2f2-68a7627f273f None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:11.522684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:11.523731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:11.524014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:11.524247 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] PATH_INFO: `/v3/projects/f9c575fd32434e03bfc3d9615822a8db` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:11.525463 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c575fd32434e03bfc3d9615822a8db)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:11.527390 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:11.646464 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c575fd32434e03bfc3d9615822a8db', 'request_id': 'req-d2f49229-caea-4cba-aa1b-f1c876d05846'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:11.697830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c575fd32434e03bfc3d9615822a8db', 'request_id': 'req-d2f49229-caea-4cba-aa1b-f1c876d05846'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:11.703681 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c575fd32434e03bfc3d9615822a8db', 'request_id': 'req-d2f49229-caea-4cba-aa1b-f1c876d05846'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:11.714987 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] The token cache is being invalidate because project f9c575fd32434e03bfc3d9615822a8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:11.715269 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:11.715884 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:11.717937 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1342/2667] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:11 2021] DELETE /identity/v3/projects/f9c575fd32434e03bfc3d9615822a8db => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:44:11.721595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f89db-835c-468a-90ec-83a8b472aa25 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:11.731850 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f89db-835c-468a-90ec-83a8b472aa25 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:11.785255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9029ef-db40-4a06-a12f-6163b8ee5475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:11.789009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9029ef-db40-4a06-a12f-6163b8ee5475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:11.789009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9029ef-db40-4a06-a12f-6163b8ee5475 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:11.789009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9029ef-db40-4a06-a12f-6163b8ee5475 admin admin] PATH_INFO: `/v3/users/cec1eebdb9b1487da746ef90b5068332` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:11.789009 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9029ef-db40-4a06-a12f-6163b8ee5475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec1eebdb9b1487da746ef90b5068332)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:11.789779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9029ef-db40-4a06-a12f-6163b8ee5475 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:11.950126 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3a9029ef-db40-4a06-a12f-6163b8ee5475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec1eebdb9b1487da746ef90b5068332'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:11.951090 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3a9029ef-db40-4a06-a12f-6163b8ee5475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec1eebdb9b1487da746ef90b5068332'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:11.958731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3a9029ef-db40-4a06-a12f-6163b8ee5475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec1eebdb9b1487da746ef90b5068332'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:12.017606 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3a9029ef-db40-4a06-a12f-6163b8ee5475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec1eebdb9b1487da746ef90b5068332'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:12.029614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3a9029ef-db40-4a06-a12f-6163b8ee5475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec1eebdb9b1487da746ef90b5068332'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:12.035759 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1326/2668] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:11 2021] DELETE /identity/v3/users/cec1eebdb9b1487da746ef90b5068332 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:12.442773 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:12.444885 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:12.460997 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f49229-caea-4cba-aa1b-f1c876d05846 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:12.523022 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:12.523887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:12.524184 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:12.524521 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87 admin admin] PATH_INFO: `/v3/projects/b09ed877d7934f17883ebaeccfc90388` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:12.525702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09ed877d7934f17883ebaeccfc90388)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:12.527674 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:12.605114 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09ed877d7934f17883ebaeccfc90388', 'request_id': 'req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:12.646065 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09ed877d7934f17883ebaeccfc90388', 'request_id': 'req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:12.651812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09ed877d7934f17883ebaeccfc90388', 'request_id': 'req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:12.663049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87 admin admin] The token cache is being invalidate because project b09ed877d7934f17883ebaeccfc90388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:12.663340 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:12.663971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-adbee01b-50fb-4cc3-8fad-aba10cdc6c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:12.665489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1343/2669] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:12 2021] DELETE /identity/v3/projects/b09ed877d7934f17883ebaeccfc90388 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:12.671307 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98433028-41fa-4f73-a51c-ad525c1c1b82 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:12.671691 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98433028-41fa-4f73-a51c-ad525c1c1b82 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:12.672038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98433028-41fa-4f73-a51c-ad525c1c1b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:12.692736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-98433028-41fa-4f73-a51c-ad525c1c1b82 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:12.694146 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-98433028-41fa-4f73-a51c-ad525c1c1b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:12.752924 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1327/2670] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:44:12.761388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45343ac7-f20a-4fb7-be5e-0d805bbeb19e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:12.761681 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45343ac7-f20a-4fb7-be5e-0d805bbeb19e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:12.761986 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45343ac7-f20a-4fb7-be5e-0d805bbeb19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:12.785429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-45343ac7-f20a-4fb7-be5e-0d805bbeb19e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:12.785429 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-45343ac7-f20a-4fb7-be5e-0d805bbeb19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:12.792102 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1344/2671] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:12.796368 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98433028-41fa-4f73-a51c-ad525c1c1b82 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:12.806670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98433028-41fa-4f73-a51c-ad525c1c1b82 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:12.811305 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc1a34-0181-429e-8155-ea0b2fa4d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:12.811955 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc1a34-0181-429e-8155-ea0b2fa4d6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:12.812236 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc1a34-0181-429e-8155-ea0b2fa4d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:12.812513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc1a34-0181-429e-8155-ea0b2fa4d6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:12.813267 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc1a34-0181-429e-8155-ea0b2fa4d6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:44:12.813577 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc1a34-0181-429e-8155-ea0b2fa4d6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:12.815196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc1a34-0181-429e-8155-ea0b2fa4d6d7 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:12.826415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1328/2672] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:44:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 14:44:12.832173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45343ac7-f20a-4fb7-be5e-0d805bbeb19e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:12.841440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45343ac7-f20a-4fb7-be5e-0d805bbeb19e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:12.846386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fa0ad-1a90-4a1c-8532-118df7e8f54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:12.847671 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fa0ad-1a90-4a1c-8532-118df7e8f54f admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:12.847954 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fa0ad-1a90-4a1c-8532-118df7e8f54f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:12.848481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fa0ad-1a90-4a1c-8532-118df7e8f54f admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:12.849178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fa0ad-1a90-4a1c-8532-118df7e8f54f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:12.852159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fa0ad-1a90-4a1c-8532-118df7e8f54f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:12.960595 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1345/2673] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:44:12 2021] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:12.961722 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc1a34-0181-429e-8155-ea0b2fa4d6d7 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:12.971671 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc1a34-0181-429e-8155-ea0b2fa4d6d7 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:13.026901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1798d0-d824-4784-9aa4-5c94bb25813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:13.027564 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1798d0-d824-4784-9aa4-5c94bb25813f admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:13.027837 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1798d0-d824-4784-9aa4-5c94bb25813f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:13.028106 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1798d0-d824-4784-9aa4-5c94bb25813f admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:13.028779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1798d0-d824-4784-9aa4-5c94bb25813f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:13.030694 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1798d0-d824-4784-9aa4-5c94bb25813f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:13.123946 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1329/2674] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:44:12 2021] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:13.125265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fa0ad-1a90-4a1c-8532-118df7e8f54f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:13.135627 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fa0ad-1a90-4a1c-8532-118df7e8f54f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:13.140553 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70052224-6bc2-43f5-865f-7c09309cf923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:13.141211 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70052224-6bc2-43f5-865f-7c09309cf923 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:13.141546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70052224-6bc2-43f5-865f-7c09309cf923 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:13.141847 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70052224-6bc2-43f5-865f-7c09309cf923 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:13.142619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70052224-6bc2-43f5-865f-7c09309cf923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:13.144958 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70052224-6bc2-43f5-865f-7c09309cf923 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:13.155814 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1346/2675] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:44:13.160642 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1798d0-d824-4784-9aa4-5c94bb25813f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:13.171167 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1798d0-d824-4784-9aa4-5c94bb25813f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:13.176070 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7faf73d-2db1-4bd7-842b-6d1a646eb038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:13.176725 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faf73d-2db1-4bd7-842b-6d1a646eb038 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:13.177003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faf73d-2db1-4bd7-842b-6d1a646eb038 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:13.177271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faf73d-2db1-4bd7-842b-6d1a646eb038 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:13.178016 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7faf73d-2db1-4bd7-842b-6d1a646eb038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:13.179779 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7faf73d-2db1-4bd7-842b-6d1a646eb038 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:13.189528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1330/2676] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:13.193702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70052224-6bc2-43f5-865f-7c09309cf923 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:13.203367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70052224-6bc2-43f5-865f-7c09309cf923 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:13.208862 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b98a1-97ee-4e49-b400-7fece818654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:13.209655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b98a1-97ee-4e49-b400-7fece818654e admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:13.209957 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b98a1-97ee-4e49-b400-7fece818654e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:13.210228 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b98a1-97ee-4e49-b400-7fece818654e admin admin] PATH_INFO: `/v3/projects/6cfeaa2120bd4551893a17a02575c0ed/users/ffad6cf3278f40a4a78a570b73467a70/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:13.225721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b98a1-97ee-4e49-b400-7fece818654e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cfeaa2120bd4551893a17a02575c0ed, user_id=ffad6cf3278f40a4a78a570b73467a70, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:13.228639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b98a1-97ee-4e49-b400-7fece818654e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:13.308780 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1347/2677] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:13 2021] PUT /identity/v3/projects/6cfeaa2120bd4551893a17a02575c0ed/users/ffad6cf3278f40a4a78a570b73467a70/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:13.319038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a640-72f9-443a-9b9e-61d6b520e593 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:13.319376 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a640-72f9-443a-9b9e-61d6b520e593 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:13.319662 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382a640-72f9-443a-9b9e-61d6b520e593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:13.348623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-5382a640-72f9-443a-9b9e-61d6b520e593 None None] MFA Rules not processed for user `ffad6cf3278f40a4a78a570b73467a70`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:13.349839 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5382a640-72f9-443a-9b9e-61d6b520e593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:13.411188 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1331/2678] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:13 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:13.415688 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b98a1-97ee-4e49-b400-7fece818654e admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:13.474864 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b98a1-97ee-4e49-b400-7fece818654e admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:13.479630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c07b5-2ee9-4156-bf7c-263164d8bd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:13.480290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c07b5-2ee9-4156-bf7c-263164d8bd70 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:13.480574 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c07b5-2ee9-4156-bf7c-263164d8bd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:13.480852 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c07b5-2ee9-4156-bf7c-263164d8bd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:13.481539 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c07b5-2ee9-4156-bf7c-263164d8bd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:13.483484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c07b5-2ee9-4156-bf7c-263164d8bd70 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:13.578926 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1348/2679] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:44:13 2021] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:13.583583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a640-72f9-443a-9b9e-61d6b520e593 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:13.594045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382a640-72f9-443a-9b9e-61d6b520e593 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:13.648054 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95592d8c-d94d-44ce-a1a7-4294e9a1cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:13.648709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95592d8c-d94d-44ce-a1a7-4294e9a1cce3 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:13.648987 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95592d8c-d94d-44ce-a1a7-4294e9a1cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:13.649261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95592d8c-d94d-44ce-a1a7-4294e9a1cce3 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:13.649964 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95592d8c-d94d-44ce-a1a7-4294e9a1cce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:13.651847 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95592d8c-d94d-44ce-a1a7-4294e9a1cce3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:13.773173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1332/2680] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:44:13 2021] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:44:13.777020 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c07b5-2ee9-4156-bf7c-263164d8bd70 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:13.787442 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c07b5-2ee9-4156-bf7c-263164d8bd70 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:13.792070 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d457d4b-c5f1-4340-a043-bcc5ff05bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:13.797530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d457d4b-c5f1-4340-a043-bcc5ff05bd34 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:13.797530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d457d4b-c5f1-4340-a043-bcc5ff05bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:13.797530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d457d4b-c5f1-4340-a043-bcc5ff05bd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:13.797530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d457d4b-c5f1-4340-a043-bcc5ff05bd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:13.797530 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d457d4b-c5f1-4340-a043-bcc5ff05bd34 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:13.809045 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1349/2681] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:13.811352 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95592d8c-d94d-44ce-a1a7-4294e9a1cce3 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:13.822784 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95592d8c-d94d-44ce-a1a7-4294e9a1cce3 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:13.827806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652ee44-57eb-4d04-b253-6ce8eac36535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:13.828795 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652ee44-57eb-4d04-b253-6ce8eac36535 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:13.829130 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652ee44-57eb-4d04-b253-6ce8eac36535 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:13.829365 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652ee44-57eb-4d04-b253-6ce8eac36535 admin admin] PATH_INFO: `/v3/projects/c837472902b84ee391cc17d398eb726b/users/4232cb9f515a4e968b768884e9468492/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:13.847161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652ee44-57eb-4d04-b253-6ce8eac36535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c837472902b84ee391cc17d398eb726b, user_id=4232cb9f515a4e968b768884e9468492, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:13.850861 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652ee44-57eb-4d04-b253-6ce8eac36535 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:14.172205 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1333/2682] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:13 2021] PUT /identity/v3/projects/c837472902b84ee391cc17d398eb726b/users/4232cb9f515a4e968b768884e9468492/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:14.177116 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d457d4b-c5f1-4340-a043-bcc5ff05bd34 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:14.186977 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d457d4b-c5f1-4340-a043-bcc5ff05bd34 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:14.246121 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f8ecd-0a2e-4965-8829-32ea1441a70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:14.246816 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f8ecd-0a2e-4965-8829-32ea1441a70e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:14.247102 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f8ecd-0a2e-4965-8829-32ea1441a70e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:14.247380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f8ecd-0a2e-4965-8829-32ea1441a70e admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:14.248100 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f8ecd-0a2e-4965-8829-32ea1441a70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:14.249700 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f8ecd-0a2e-4965-8829-32ea1441a70e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:14.263403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1350/2683] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:14 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:14.267929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652ee44-57eb-4d04-b253-6ce8eac36535 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:14.278198 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652ee44-57eb-4d04-b253-6ce8eac36535 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:14.283023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829c9d2-3370-44d7-9e35-0fb6d773b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:14.283893 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829c9d2-3370-44d7-9e35-0fb6d773b4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:14.284171 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829c9d2-3370-44d7-9e35-0fb6d773b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:14.284960 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829c9d2-3370-44d7-9e35-0fb6d773b4e6 admin admin] PATH_INFO: `/v3/projects/c837472902b84ee391cc17d398eb726b/users/4232cb9f515a4e968b768884e9468492/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:14.287035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829c9d2-3370-44d7-9e35-0fb6d773b4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c837472902b84ee391cc17d398eb726b, user_id=4232cb9f515a4e968b768884e9468492, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:14.289618 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829c9d2-3370-44d7-9e35-0fb6d773b4e6 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:14.299846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1334/2684] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:14 2021] PUT /identity/v3/projects/c837472902b84ee391cc17d398eb726b/users/4232cb9f515a4e968b768884e9468492/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:44:14.310611 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaba243-ef58-42dc-ae9c-fe003292817e None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:14.310899 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaba243-ef58-42dc-ae9c-fe003292817e None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:14.311175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaba243-ef58-42dc-ae9c-fe003292817e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:14.336916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-bdaba243-ef58-42dc-ae9c-fe003292817e None None] MFA Rules not processed for user `4232cb9f515a4e968b768884e9468492`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:14.338175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-bdaba243-ef58-42dc-ae9c-fe003292817e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:14.404169 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1351/2685] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:14 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:44:14.414941 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829c9d2-3370-44d7-9e35-0fb6d773b4e6 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:14.416659 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-b829c9d2-3370-44d7-9e35-0fb6d773b4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:14.471396 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829c9d2-3370-44d7-9e35-0fb6d773b4e6 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:14.476299 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad35fc-1820-4b99-960b-3003df6db288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:14.476755 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad35fc-1820-4b99-960b-3003df6db288 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:14.477036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad35fc-1820-4b99-960b-3003df6db288 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:14.477314 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad35fc-1820-4b99-960b-3003df6db288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:14.486456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad35fc-1820-4b99-960b-3003df6db288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:14.488571 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad35fc-1820-4b99-960b-3003df6db288 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:14.497757 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1335/2686] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:14 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:14.996249 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaba243-ef58-42dc-ae9c-fe003292817e None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:15.058128 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaba243-ef58-42dc-ae9c-fe003292817e None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:15.062697 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:15.063562 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:15.063839 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:15.064143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] PATH_INFO: `/v3/users/ffad6cf3278f40a4a78a570b73467a70` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:15.065318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffad6cf3278f40a4a78a570b73467a70)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:15.067953 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:15.299400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffad6cf3278f40a4a78a570b73467a70'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:15.300868 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffad6cf3278f40a4a78a570b73467a70'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:15.301719 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffad6cf3278f40a4a78a570b73467a70'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:15.395270 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffad6cf3278f40a4a78a570b73467a70'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:15.407379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffad6cf3278f40a4a78a570b73467a70'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:15.420219 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1352/2687] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:14 2021] DELETE /identity/v3/users/ffad6cf3278f40a4a78a570b73467a70 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:15.426169 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5fea7-21b2-45bc-9273-15babc066ab6 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:15.433603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5fea7-21b2-45bc-9273-15babc066ab6 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:15.433603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5fea7-21b2-45bc-9273-15babc066ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:15.446082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-5ae5fea7-21b2-45bc-9273-15babc066ab6 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:15.447288 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5ae5fea7-21b2-45bc-9273-15babc066ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:15.503651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1336/2688] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:44:15.514852 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:15.516322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:15.576518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58943064-c995-4d11-86a3-545ec14272e6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:15.580722 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574f685-011c-47d8-bf77-1968364b8559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:15.581494 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574f685-011c-47d8-bf77-1968364b8559 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:15.581781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574f685-011c-47d8-bf77-1968364b8559 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:15.582090 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574f685-011c-47d8-bf77-1968364b8559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:15.591394 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574f685-011c-47d8-bf77-1968364b8559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:15.592863 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574f685-011c-47d8-bf77-1968364b8559 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:15.603170 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1353/2689] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:44:16.025217 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5fea7-21b2-45bc-9273-15babc066ab6 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:16.026763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5ae5fea7-21b2-45bc-9273-15babc066ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:16.041906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5fea7-21b2-45bc-9273-15babc066ab6 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:16.047112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:16.048473 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:16.048769 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:16.049207 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] PATH_INFO: `/v3/projects/6cfeaa2120bd4551893a17a02575c0ed` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:16.051150 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cfeaa2120bd4551893a17a02575c0ed)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:16.053285 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:16.154801 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cfeaa2120bd4551893a17a02575c0ed', 'request_id': 'req-4422be42-c95a-429f-ab67-5efa63d84d81'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:16.234625 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cfeaa2120bd4551893a17a02575c0ed', 'request_id': 'req-4422be42-c95a-429f-ab67-5efa63d84d81'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:16.241834 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cfeaa2120bd4551893a17a02575c0ed', 'request_id': 'req-4422be42-c95a-429f-ab67-5efa63d84d81'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:16.253112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] The token cache is being invalidate because project 6cfeaa2120bd4551893a17a02575c0ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:16.253929 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:16.254234 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:16.256088 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1337/2690] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:16 2021] DELETE /identity/v3/projects/6cfeaa2120bd4551893a17a02575c0ed => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:16.259890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574f685-011c-47d8-bf77-1968364b8559 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:16.272120 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574f685-011c-47d8-bf77-1968364b8559 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:16.339008 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:16.340170 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:16.340546 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:16.340915 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] PATH_INFO: `/v3/users/4232cb9f515a4e968b768884e9468492` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:16.342356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4232cb9f515a4e968b768884e9468492)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:16.344360 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:16.551680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4232cb9f515a4e968b768884e9468492'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:16.552400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4232cb9f515a4e968b768884e9468492'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:16.553149 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4232cb9f515a4e968b768884e9468492'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:16.645888 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4232cb9f515a4e968b768884e9468492'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:16.650929 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4232cb9f515a4e968b768884e9468492'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:16.663511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1354/2691] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:16 2021] DELETE /identity/v3/users/4232cb9f515a4e968b768884e9468492 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:44:16.687388 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:16.689592 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:16.783456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422be42-c95a-429f-ab67-5efa63d84d81 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:16.832861 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadeb3f-98dc-49dc-869d-e73d0346de47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:16.833509 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadeb3f-98dc-49dc-869d-e73d0346de47 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:16.833790 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadeb3f-98dc-49dc-869d-e73d0346de47 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:16.834093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadeb3f-98dc-49dc-869d-e73d0346de47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:16.835845 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8dadeb3f-98dc-49dc-869d-e73d0346de47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:16.844868 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadeb3f-98dc-49dc-869d-e73d0346de47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:16.846394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadeb3f-98dc-49dc-869d-e73d0346de47 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:16.854383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1338/2692] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:16 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:44:17.139865 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:17.141404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:17.220607 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766f9e4-ccc0-42d0-9c56-4517dc48f843 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:17.226314 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172fda6-6cd7-4696-91d9-b115fd3de4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:17.227203 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172fda6-6cd7-4696-91d9-b115fd3de4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:17.227757 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172fda6-6cd7-4696-91d9-b115fd3de4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:17.227757 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172fda6-6cd7-4696-91d9-b115fd3de4b3 admin admin] PATH_INFO: `/v3/projects/c837472902b84ee391cc17d398eb726b` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:17.228965 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172fda6-6cd7-4696-91d9-b115fd3de4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c837472902b84ee391cc17d398eb726b)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:17.230944 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172fda6-6cd7-4696-91d9-b115fd3de4b3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:17.367035 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4172fda6-6cd7-4696-91d9-b115fd3de4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c837472902b84ee391cc17d398eb726b', 'request_id': 'req-4172fda6-6cd7-4696-91d9-b115fd3de4b3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:17.440484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4172fda6-6cd7-4696-91d9-b115fd3de4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c837472902b84ee391cc17d398eb726b', 'request_id': 'req-4172fda6-6cd7-4696-91d9-b115fd3de4b3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:17.446559 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4172fda6-6cd7-4696-91d9-b115fd3de4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c837472902b84ee391cc17d398eb726b', 'request_id': 'req-4172fda6-6cd7-4696-91d9-b115fd3de4b3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:17.457946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4172fda6-6cd7-4696-91d9-b115fd3de4b3 admin admin] The token cache is being invalidate because project c837472902b84ee391cc17d398eb726b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:17.458236 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4172fda6-6cd7-4696-91d9-b115fd3de4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:17.458876 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4172fda6-6cd7-4696-91d9-b115fd3de4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:17.460408 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1355/2693] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:17 2021] DELETE /identity/v3/projects/c837472902b84ee391cc17d398eb726b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:17.466065 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed16bc8-a857-4f30-baae-b857ba222f68 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:17.466351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed16bc8-a857-4f30-baae-b857ba222f68 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:17.466656 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed16bc8-a857-4f30-baae-b857ba222f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:17.485126 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-aed16bc8-a857-4f30-baae-b857ba222f68 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:17.486283 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-aed16bc8-a857-4f30-baae-b857ba222f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:17.550805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1339/2694] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:17.559639 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88718e1-1eb6-4c01-a5a2-299b60d9a724 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:17.575603 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88718e1-1eb6-4c01-a5a2-299b60d9a724 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:17.575603 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88718e1-1eb6-4c01-a5a2-299b60d9a724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:17.578189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-d88718e1-1eb6-4c01-a5a2-299b60d9a724 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:17.579386 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-d88718e1-1eb6-4c01-a5a2-299b60d9a724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:17.587815 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1356/2695] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:17.592746 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed16bc8-a857-4f30-baae-b857ba222f68 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:17.603884 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed16bc8-a857-4f30-baae-b857ba222f68 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:17.608843 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f6d59-6755-437b-884b-5d4282f900ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:17.609504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f6d59-6755-437b-884b-5d4282f900ee admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:17.609940 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f6d59-6755-437b-884b-5d4282f900ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:17.610364 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f6d59-6755-437b-884b-5d4282f900ee admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:17.611082 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f6d59-6755-437b-884b-5d4282f900ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:44:17.611675 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f6d59-6755-437b-884b-5d4282f900ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:17.619961 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f6d59-6755-437b-884b-5d4282f900ee admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:17.629906 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1340/2696] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:44:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:44:17.636278 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88718e1-1eb6-4c01-a5a2-299b60d9a724 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:17.645962 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88718e1-1eb6-4c01-a5a2-299b60d9a724 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:17.650650 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1840c8-f2b3-4c23-a7bd-04ab633a4b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:17.651292 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1840c8-f2b3-4c23-a7bd-04ab633a4b77 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:17.651570 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1840c8-f2b3-4c23-a7bd-04ab633a4b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:17.651869 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1840c8-f2b3-4c23-a7bd-04ab633a4b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:17.652555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1840c8-f2b3-4c23-a7bd-04ab633a4b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:17.654487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1840c8-f2b3-4c23-a7bd-04ab633a4b77 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:17.786126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1357/2697] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:44:17 2021] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:17.790353 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f6d59-6755-437b-884b-5d4282f900ee admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:17.801256 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f6d59-6755-437b-884b-5d4282f900ee admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:17.879469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b1226-7efd-4dd3-a335-ef3d5fb39822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:17.880147 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b1226-7efd-4dd3-a335-ef3d5fb39822 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:17.880433 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b1226-7efd-4dd3-a335-ef3d5fb39822 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:17.880709 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b1226-7efd-4dd3-a335-ef3d5fb39822 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:17.881395 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b1226-7efd-4dd3-a335-ef3d5fb39822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:17.883350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b1226-7efd-4dd3-a335-ef3d5fb39822 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:17.986852 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1341/2698] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:44:17 2021] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:17.988069 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1840c8-f2b3-4c23-a7bd-04ab633a4b77 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:18.005336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1840c8-f2b3-4c23-a7bd-04ab633a4b77 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:18.005336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cd07f-8966-4e51-b4e5-835def118347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:18.005336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cd07f-8966-4e51-b4e5-835def118347 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:18.005336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cd07f-8966-4e51-b4e5-835def118347 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:18.005818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cd07f-8966-4e51-b4e5-835def118347 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:18.005818 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cd07f-8966-4e51-b4e5-835def118347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:18.007133 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cd07f-8966-4e51-b4e5-835def118347 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:18.017414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1358/2699] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:18.022157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b1226-7efd-4dd3-a335-ef3d5fb39822 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:18.032381 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b1226-7efd-4dd3-a335-ef3d5fb39822 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:18.037292 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c6cf6-320b-4b8a-bf5d-2b7c2dc286ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:18.039350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c6cf6-320b-4b8a-bf5d-2b7c2dc286ef admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:18.039350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c6cf6-320b-4b8a-bf5d-2b7c2dc286ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:18.039350 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c6cf6-320b-4b8a-bf5d-2b7c2dc286ef admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:18.039682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c6cf6-320b-4b8a-bf5d-2b7c2dc286ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:18.041179 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c6cf6-320b-4b8a-bf5d-2b7c2dc286ef admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:18.052135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1342/2700] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:18.056233 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cd07f-8966-4e51-b4e5-835def118347 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:18.066970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cd07f-8966-4e51-b4e5-835def118347 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:18.071970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ff4ad-e877-43a2-bd39-85400180ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:18.072875 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ff4ad-e877-43a2-bd39-85400180ebba admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:18.073188 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ff4ad-e877-43a2-bd39-85400180ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:18.073465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ff4ad-e877-43a2-bd39-85400180ebba admin admin] PATH_INFO: `/v3/projects/7ad7b36c8d0041c5a7443bcb23e720f3/users/f6d2a268b9f745b79cd342f9c54f7755/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:18.088474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ff4ad-e877-43a2-bd39-85400180ebba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad7b36c8d0041c5a7443bcb23e720f3, user_id=f6d2a268b9f745b79cd342f9c54f7755, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:18.091267 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ff4ad-e877-43a2-bd39-85400180ebba admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:18.195524 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1359/2701] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:18 2021] PUT /identity/v3/projects/7ad7b36c8d0041c5a7443bcb23e720f3/users/f6d2a268b9f745b79cd342f9c54f7755/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:18.200713 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478066c-ae86-4abb-9f5f-5a75c66d157b None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:18.201068 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478066c-ae86-4abb-9f5f-5a75c66d157b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:18.201371 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478066c-ae86-4abb-9f5f-5a75c66d157b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:18.222424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-0478066c-ae86-4abb-9f5f-5a75c66d157b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:18.223623 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0478066c-ae86-4abb-9f5f-5a75c66d157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:18.280557 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1343/2702] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:18.290518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ff4ad-e877-43a2-bd39-85400180ebba admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:18.292258 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-950ff4ad-e877-43a2-bd39-85400180ebba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:18.350874 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ff4ad-e877-43a2-bd39-85400180ebba admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:18.354778 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff453e9-aa08-4a20-b16d-b486b636c0f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:18.355467 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff453e9-aa08-4a20-b16d-b486b636c0f4 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:18.355891 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff453e9-aa08-4a20-b16d-b486b636c0f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:18.356173 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff453e9-aa08-4a20-b16d-b486b636c0f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:18.366335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff453e9-aa08-4a20-b16d-b486b636c0f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:18.367707 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff453e9-aa08-4a20-b16d-b486b636c0f4 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:18.377266 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1360/2703] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:19.765207 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ac262-d321-4ac4-ba5a-0f2fa6d41630 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:19.765602 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ac262-d321-4ac4-ba5a-0f2fa6d41630 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:19.765793 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ac262-d321-4ac4-ba5a-0f2fa6d41630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:19.804528 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-db7ac262-d321-4ac4-ba5a-0f2fa6d41630 None None] MFA Rules not processed for user `f6d2a268b9f745b79cd342f9c54f7755`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:19.805938 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-db7ac262-d321-4ac4-ba5a-0f2fa6d41630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:19.898037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1344/2704] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:19 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:19.899410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff453e9-aa08-4a20-b16d-b486b636c0f4 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:19.910864 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff453e9-aa08-4a20-b16d-b486b636c0f4 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:19.916267 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddec10-c731-46cc-be7a-a008c52f0884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:19.917115 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddec10-c731-46cc-be7a-a008c52f0884 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:19.917392 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddec10-c731-46cc-be7a-a008c52f0884 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:19.917662 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddec10-c731-46cc-be7a-a008c52f0884 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:19.918403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddec10-c731-46cc-be7a-a008c52f0884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:19.920298 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddec10-c731-46cc-be7a-a008c52f0884 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:19.984868 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1361/2705] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:44:19 2021] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:19.989668 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ac262-d321-4ac4-ba5a-0f2fa6d41630 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:20.000840 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ac262-d321-4ac4-ba5a-0f2fa6d41630 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:20.058504 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0f35c-299e-4d8d-b1a9-a0edd72766b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:20.059183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0f35c-299e-4d8d-b1a9-a0edd72766b3 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:20.059465 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0f35c-299e-4d8d-b1a9-a0edd72766b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:20.059740 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0f35c-299e-4d8d-b1a9-a0edd72766b3 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:20.060456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0f35c-299e-4d8d-b1a9-a0edd72766b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:20.062363 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0f35c-299e-4d8d-b1a9-a0edd72766b3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:20.181477 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1345/2706] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:44:19 2021] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:20.183053 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddec10-c731-46cc-be7a-a008c52f0884 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:20.194549 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddec10-c731-46cc-be7a-a008c52f0884 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:20.199732 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be220-899f-499e-af28-7ccd2eda4399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:20.200419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be220-899f-499e-af28-7ccd2eda4399 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:20.200703 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be220-899f-499e-af28-7ccd2eda4399 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:20.200984 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be220-899f-499e-af28-7ccd2eda4399 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:20.201751 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be220-899f-499e-af28-7ccd2eda4399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:20.203529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be220-899f-499e-af28-7ccd2eda4399 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:20.215629 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1362/2707] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:20 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:20.220110 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0f35c-299e-4d8d-b1a9-a0edd72766b3 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:20.230787 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0f35c-299e-4d8d-b1a9-a0edd72766b3 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:20.238846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd53c23-a6ed-441d-8161-9cffbace59cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:20.239780 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd53c23-a6ed-441d-8161-9cffbace59cf admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:20.240056 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd53c23-a6ed-441d-8161-9cffbace59cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:20.240329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd53c23-a6ed-441d-8161-9cffbace59cf admin admin] PATH_INFO: `/v3/projects/7f609a8a83614ed5b4f32daa50e2f281/users/0482c002dc9f486daace355bf9fa14a2/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:20.258467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd53c23-a6ed-441d-8161-9cffbace59cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f609a8a83614ed5b4f32daa50e2f281, user_id=0482c002dc9f486daace355bf9fa14a2, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:20.261415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd53c23-a6ed-441d-8161-9cffbace59cf admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:20.355631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1346/2708] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:20 2021] PUT /identity/v3/projects/7f609a8a83614ed5b4f32daa50e2f281/users/0482c002dc9f486daace355bf9fa14a2/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:20.359557 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be220-899f-499e-af28-7ccd2eda4399 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:20.370936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be220-899f-499e-af28-7ccd2eda4399 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:20.428014 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2166c-c5f0-489d-9dd7-b1e0be74f81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:20.428684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2166c-c5f0-489d-9dd7-b1e0be74f81e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:20.428976 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2166c-c5f0-489d-9dd7-b1e0be74f81e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:20.429255 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2166c-c5f0-489d-9dd7-b1e0be74f81e admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:20.430027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2166c-c5f0-489d-9dd7-b1e0be74f81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:20.431599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2166c-c5f0-489d-9dd7-b1e0be74f81e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:20.441619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1363/2709] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:20 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:20.446064 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd53c23-a6ed-441d-8161-9cffbace59cf admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:20.456063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd53c23-a6ed-441d-8161-9cffbace59cf admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:20.460643 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0f7b4-22c3-4387-a598-ff0f8c3f9a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:20.461507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0f7b4-22c3-4387-a598-ff0f8c3f9a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:20.461789 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0f7b4-22c3-4387-a598-ff0f8c3f9a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:20.462137 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0f7b4-22c3-4387-a598-ff0f8c3f9a71 admin admin] PATH_INFO: `/v3/projects/7f609a8a83614ed5b4f32daa50e2f281/users/0482c002dc9f486daace355bf9fa14a2/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:20.464100 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0f7b4-22c3-4387-a598-ff0f8c3f9a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f609a8a83614ed5b4f32daa50e2f281, user_id=0482c002dc9f486daace355bf9fa14a2, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:20.466818 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0f7b4-22c3-4387-a598-ff0f8c3f9a71 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:20.477608 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1347/2710] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:20 2021] PUT /identity/v3/projects/7f609a8a83614ed5b4f32daa50e2f281/users/0482c002dc9f486daace355bf9fa14a2/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:44:21.879191 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d919d74-c1c7-4f9f-bc42-5f99d70a2784 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:21.879913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d919d74-c1c7-4f9f-bc42-5f99d70a2784 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:21.879913 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d919d74-c1c7-4f9f-bc42-5f99d70a2784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:21.908282 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3d919d74-c1c7-4f9f-bc42-5f99d70a2784 None None] MFA Rules not processed for user `0482c002dc9f486daace355bf9fa14a2`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:21.909578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3d919d74-c1c7-4f9f-bc42-5f99d70a2784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:21.979153 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1364/2711] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:21 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:21.989773 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0f7b4-22c3-4387-a598-ff0f8c3f9a71 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:21.991555 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-9ba0f7b4-22c3-4387-a598-ff0f8c3f9a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:22.046792 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0f7b4-22c3-4387-a598-ff0f8c3f9a71 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:22.051020 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ef2c9-b027-4d27-8c12-a8789cc2caf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:22.051670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef2c9-b027-4d27-8c12-a8789cc2caf0 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:22.051948 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef2c9-b027-4d27-8c12-a8789cc2caf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:22.052221 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef2c9-b027-4d27-8c12-a8789cc2caf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:22.106895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ef2c9-b027-4d27-8c12-a8789cc2caf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:22.108328 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ef2c9-b027-4d27-8c12-a8789cc2caf0 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:22.117916 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1348/2712] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:21 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:22.178731 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d919d74-c1c7-4f9f-bc42-5f99d70a2784 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:22.180138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3d919d74-c1c7-4f9f-bc42-5f99d70a2784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:22.255387 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d919d74-c1c7-4f9f-bc42-5f99d70a2784 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:22.259825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:22.260690 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:22.260970 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:22.261245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] PATH_INFO: `/v3/users/79a50b7b83674f459dd2bc8db577fb29` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:22.262465 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a50b7b83674f459dd2bc8db577fb29)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:22.264380 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:22.447905 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a50b7b83674f459dd2bc8db577fb29'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:22.448716 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a50b7b83674f459dd2bc8db577fb29'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:22.449419 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a50b7b83674f459dd2bc8db577fb29'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:22.560382 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a50b7b83674f459dd2bc8db577fb29'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:22.574745 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a50b7b83674f459dd2bc8db577fb29'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:22.594201 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f140-b462-4710-9768-1775488ad677 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:22.594569 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f140-b462-4710-9768-1775488ad677 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:22.594852 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f140-b462-4710-9768-1775488ad677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:22.596927 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1365/2713] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:22 2021] DELETE /identity/v3/users/79a50b7b83674f459dd2bc8db577fb29 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:22.613849 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e289f140-b462-4710-9768-1775488ad677 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:22.615383 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e289f140-b462-4710-9768-1775488ad677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:22.674747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1349/2714] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:22.686589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:22.687998 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:22.748578 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b08d1-2c5a-4038-88c8-f24ea19b16ec admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:22.752265 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429f042-d557-4d34-a500-51203bd5ebef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:22.752939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429f042-d557-4d34-a500-51203bd5ebef service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:22.753238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429f042-d557-4d34-a500-51203bd5ebef service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:22.753531 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429f042-d557-4d34-a500-51203bd5ebef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:22.762679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429f042-d557-4d34-a500-51203bd5ebef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:22.764189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429f042-d557-4d34-a500-51203bd5ebef service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:22.775733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1366/2715] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:23.168681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289f140-b462-4710-9768-1775488ad677 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:23.170156 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e289f140-b462-4710-9768-1775488ad677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:23.182243 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289f140-b462-4710-9768-1775488ad677 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:23.187822 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:23.187822 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:23.188047 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:23.188193 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] PATH_INFO: `/v3/projects/e20fbc7614fb4be3a3c041d96abe2ad2` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:23.189415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20fbc7614fb4be3a3c041d96abe2ad2)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:23.191319 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:23.268325 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20fbc7614fb4be3a3c041d96abe2ad2', 'request_id': 'req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:23.330772 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20fbc7614fb4be3a3c041d96abe2ad2', 'request_id': 'req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:23.336928 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20fbc7614fb4be3a3c041d96abe2ad2', 'request_id': 'req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:23.347767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] The token cache is being invalidate because project e20fbc7614fb4be3a3c041d96abe2ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:23.348317 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:23.348939 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:23.350633 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1350/2716] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:23 2021] DELETE /identity/v3/projects/e20fbc7614fb4be3a3c041d96abe2ad2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:23.865529 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429f042-d557-4d34-a500-51203bd5ebef service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:23.867077 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a429f042-d557-4d34-a500-51203bd5ebef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:23.934370 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429f042-d557-4d34-a500-51203bd5ebef service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:23.984337 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6547ae5-721a-4b11-8d9c-63873e3fe41a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:23.984991 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6547ae5-721a-4b11-8d9c-63873e3fe41a service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:23.986845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6547ae5-721a-4b11-8d9c-63873e3fe41a service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:23.986845 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6547ae5-721a-4b11-8d9c-63873e3fe41a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:23.987414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-b6547ae5-721a-4b11-8d9c-63873e3fe41a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:24.048695 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6547ae5-721a-4b11-8d9c-63873e3fe41a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:24.050163 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6547ae5-721a-4b11-8d9c-63873e3fe41a service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:24.060261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1367/2717] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:23 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:39.839482 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:39.840996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:39.902863 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cfda8-69e9-40a1-9f2b-3b379f1c30a0 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:39.907589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:39.908481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:39.908763 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:39.909040 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] PATH_INFO: `/v3/users/f6d2a268b9f745b79cd342f9c54f7755` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:39.910255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d2a268b9f745b79cd342f9c54f7755)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:39.912720 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:40.099387 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d2a268b9f745b79cd342f9c54f7755'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.100750 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d2a268b9f745b79cd342f9c54f7755'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.107421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d2a268b9f745b79cd342f9c54f7755'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.142649 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d2a268b9f745b79cd342f9c54f7755'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.154927 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d2a268b9f745b79cd342f9c54f7755'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.160589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1351/2718] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:39 2021] DELETE /identity/v3/users/f6d2a268b9f745b79cd342f9c54f7755 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:40.385881 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6547ae5-721a-4b11-8d9c-63873e3fe41a service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:40.406285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6547ae5-721a-4b11-8d9c-63873e3fe41a service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:40.477608 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:40.478512 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:40.478813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:40.479102 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] PATH_INFO: `/v3/projects/7ad7b36c8d0041c5a7443bcb23e720f3` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:40.480304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad7b36c8d0041c5a7443bcb23e720f3)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:40.482263 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:40.552889 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad7b36c8d0041c5a7443bcb23e720f3', 'request_id': 'req-12db8a11-36d9-43ed-b628-2acd8ff197ea'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.599877 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad7b36c8d0041c5a7443bcb23e720f3', 'request_id': 'req-12db8a11-36d9-43ed-b628-2acd8ff197ea'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.605377 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad7b36c8d0041c5a7443bcb23e720f3', 'request_id': 'req-12db8a11-36d9-43ed-b628-2acd8ff197ea'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.616748 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] The token cache is being invalidate because project 7ad7b36c8d0041c5a7443bcb23e720f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:40.617039 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.617680 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.619245 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1368/2719] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:40 2021] DELETE /identity/v3/projects/7ad7b36c8d0041c5a7443bcb23e720f3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:40.623346 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:40.624855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:40.637957 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531df2-28ef-436b-beca-a3818d99493b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:40.694186 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677f343-b7c5-48dc-80f3-fa47aed93b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:40.695269 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677f343-b7c5-48dc-80f3-fa47aed93b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:40.695553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677f343-b7c5-48dc-80f3-fa47aed93b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:40.695825 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677f343-b7c5-48dc-80f3-fa47aed93b90 admin admin] PATH_INFO: `/v3/users/0482c002dc9f486daace355bf9fa14a2` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:40.697083 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677f343-b7c5-48dc-80f3-fa47aed93b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0482c002dc9f486daace355bf9fa14a2)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:40.699018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677f343-b7c5-48dc-80f3-fa47aed93b90 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:40.830180 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8677f343-b7c5-48dc-80f3-fa47aed93b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0482c002dc9f486daace355bf9fa14a2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.830820 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8677f343-b7c5-48dc-80f3-fa47aed93b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0482c002dc9f486daace355bf9fa14a2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.837517 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8677f343-b7c5-48dc-80f3-fa47aed93b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0482c002dc9f486daace355bf9fa14a2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.890698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8677f343-b7c5-48dc-80f3-fa47aed93b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0482c002dc9f486daace355bf9fa14a2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.902351 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8677f343-b7c5-48dc-80f3-fa47aed93b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0482c002dc9f486daace355bf9fa14a2'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:40.908147 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1352/2720] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:40 2021] DELETE /identity/v3/users/0482c002dc9f486daace355bf9fa14a2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:41.144361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:41.145784 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:41.160486 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db8a11-36d9-43ed-b628-2acd8ff197ea admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:41.217213 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da3599-49f8-4555-b11a-683055736da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:41.218094 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3599-49f8-4555-b11a-683055736da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:41.218379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3599-49f8-4555-b11a-683055736da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:41.218653 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3599-49f8-4555-b11a-683055736da4 admin admin] PATH_INFO: `/v3/projects/7f609a8a83614ed5b4f32daa50e2f281` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:41.219833 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da3599-49f8-4555-b11a-683055736da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f609a8a83614ed5b4f32daa50e2f281)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:41.221723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da3599-49f8-4555-b11a-683055736da4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:41.314317 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-10da3599-49f8-4555-b11a-683055736da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f609a8a83614ed5b4f32daa50e2f281', 'request_id': 'req-10da3599-49f8-4555-b11a-683055736da4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:41.348781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-10da3599-49f8-4555-b11a-683055736da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f609a8a83614ed5b4f32daa50e2f281', 'request_id': 'req-10da3599-49f8-4555-b11a-683055736da4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:41.354592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-10da3599-49f8-4555-b11a-683055736da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f609a8a83614ed5b4f32daa50e2f281', 'request_id': 'req-10da3599-49f8-4555-b11a-683055736da4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:41.365108 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-10da3599-49f8-4555-b11a-683055736da4 admin admin] The token cache is being invalidate because project 7f609a8a83614ed5b4f32daa50e2f281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:41.366181 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-10da3599-49f8-4555-b11a-683055736da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:41.366792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-10da3599-49f8-4555-b11a-683055736da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:41.368426 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1369/2721] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:41 2021] DELETE /identity/v3/projects/7f609a8a83614ed5b4f32daa50e2f281 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:41.374185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b6e3f-4269-4e10-80b2-70a03f1190fe None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:41.374461 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b6e3f-4269-4e10-80b2-70a03f1190fe None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:41.374730 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b6e3f-4269-4e10-80b2-70a03f1190fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:41.392545 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-921b6e3f-4269-4e10-80b2-70a03f1190fe None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:41.393701 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-921b6e3f-4269-4e10-80b2-70a03f1190fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:41.449462 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1353/2722] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:41.457234 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36224d-8829-43e3-b667-c918fc833e5c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:41.457714 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36224d-8829-43e3-b667-c918fc833e5c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:41.457813 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36224d-8829-43e3-b667-c918fc833e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:41.476295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-de36224d-8829-43e3-b667-c918fc833e5c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:41.477481 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-de36224d-8829-43e3-b667-c918fc833e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:41.485383 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1370/2723] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:41.489445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b6e3f-4269-4e10-80b2-70a03f1190fe None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:41.499469 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b6e3f-4269-4e10-80b2-70a03f1190fe None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:41.504068 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca2a3d-8536-4e3b-a953-5394df1bd352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:41.504705 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca2a3d-8536-4e3b-a953-5394df1bd352 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:41.504983 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca2a3d-8536-4e3b-a953-5394df1bd352 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:41.505253 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca2a3d-8536-4e3b-a953-5394df1bd352 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:41.506004 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca2a3d-8536-4e3b-a953-5394df1bd352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:44:41.506308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca2a3d-8536-4e3b-a953-5394df1bd352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:41.507865 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca2a3d-8536-4e3b-a953-5394df1bd352 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:41.518773 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1354/2724] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:44:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:44:41.523268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36224d-8829-43e3-b667-c918fc833e5c None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:41.532311 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36224d-8829-43e3-b667-c918fc833e5c None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:41.536949 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54805c71-c0de-4562-8162-8219a0e5e7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:41.538183 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805c71-c0de-4562-8162-8219a0e5e7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:41.538460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805c71-c0de-4562-8162-8219a0e5e7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:41.538730 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805c71-c0de-4562-8162-8219a0e5e7a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:41.539414 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54805c71-c0de-4562-8162-8219a0e5e7a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:41.541297 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54805c71-c0de-4562-8162-8219a0e5e7a6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:41.664989 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1371/2725] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:44:41 2021] POST /identity/v3/projects => generated 359 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:41.669003 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca2a3d-8536-4e3b-a953-5394df1bd352 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:41.679313 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca2a3d-8536-4e3b-a953-5394df1bd352 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:41.733583 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae01e1c-4214-4b2c-8643-c48c2f85b51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:41.734293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae01e1c-4214-4b2c-8643-c48c2f85b51b admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:41.734573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae01e1c-4214-4b2c-8643-c48c2f85b51b admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:41.734846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae01e1c-4214-4b2c-8643-c48c2f85b51b admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:41.735516 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae01e1c-4214-4b2c-8643-c48c2f85b51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:41.737426 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae01e1c-4214-4b2c-8643-c48c2f85b51b admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:41.892454 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1355/2726] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:44:41 2021] POST /identity/v3/users => generated 280 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:41.896967 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54805c71-c0de-4562-8162-8219a0e5e7a6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:41.907704 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54805c71-c0de-4562-8162-8219a0e5e7a6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:41.913606 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a597ee3-f672-4e67-a179-b0e2965428c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:41.914373 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597ee3-f672-4e67-a179-b0e2965428c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:41.914655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597ee3-f672-4e67-a179-b0e2965428c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:41.914924 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597ee3-f672-4e67-a179-b0e2965428c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:41.915755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a597ee3-f672-4e67-a179-b0e2965428c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:41.917295 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a597ee3-f672-4e67-a179-b0e2965428c3 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:41.930208 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1372/2727] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:41.933457 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae01e1c-4214-4b2c-8643-c48c2f85b51b admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:41.943930 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae01e1c-4214-4b2c-8643-c48c2f85b51b admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:41.952320 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bd106-1c0a-41a8-8a10-55af17b8a1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:41.953005 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bd106-1c0a-41a8-8a10-55af17b8a1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:41.953290 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bd106-1c0a-41a8-8a10-55af17b8a1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:41.953564 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bd106-1c0a-41a8-8a10-55af17b8a1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:41.954934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bd106-1c0a-41a8-8a10-55af17b8a1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:41.957254 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bd106-1c0a-41a8-8a10-55af17b8a1f9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:41.969141 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1356/2728] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:41 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:41.973642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a597ee3-f672-4e67-a179-b0e2965428c3 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:41.983788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a597ee3-f672-4e67-a179-b0e2965428c3 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:41.988361 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0ae51-0fe9-4628-8f33-603cc88a0974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:41.989219 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ae51-0fe9-4628-8f33-603cc88a0974 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:41.989525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ae51-0fe9-4628-8f33-603cc88a0974 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:41.989936 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ae51-0fe9-4628-8f33-603cc88a0974 admin admin] PATH_INFO: `/v3/projects/c20ade65307e41de98f09b424612586b/users/75c9d86432ae4a6d92e01568766f6142/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:42.003855 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0ae51-0fe9-4628-8f33-603cc88a0974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20ade65307e41de98f09b424612586b, user_id=75c9d86432ae4a6d92e01568766f6142, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:42.007371 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0ae51-0fe9-4628-8f33-603cc88a0974 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:42.091672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1373/2729] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:41 2021] PUT /identity/v3/projects/c20ade65307e41de98f09b424612586b/users/75c9d86432ae4a6d92e01568766f6142/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:44:42.102091 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030a371-9aca-49fa-bf4d-51c7c820158b None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:42.102387 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030a371-9aca-49fa-bf4d-51c7c820158b None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:42.102670 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030a371-9aca-49fa-bf4d-51c7c820158b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:42.128303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-1030a371-9aca-49fa-bf4d-51c7c820158b None None] MFA Rules not processed for user `75c9d86432ae4a6d92e01568766f6142`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:42.129498 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1030a371-9aca-49fa-bf4d-51c7c820158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:42.190719 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1357/2730] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:42 2021] POST /identity/v3/auth/tokens => generated 3379 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:42.218850 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0ae51-0fe9-4628-8f33-603cc88a0974 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:42.220523 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-c8e0ae51-0fe9-4628-8f33-603cc88a0974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:42.275656 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0ae51-0fe9-4628-8f33-603cc88a0974 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:42.279319 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66128597-74ea-44f5-b92f-855b2772bd41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:42.279946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128597-74ea-44f5-b92f-855b2772bd41 service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:42.280222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128597-74ea-44f5-b92f-855b2772bd41 service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:42.280489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128597-74ea-44f5-b92f-855b2772bd41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:42.288622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66128597-74ea-44f5-b92f-855b2772bd41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:42.290093 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66128597-74ea-44f5-b92f-855b2772bd41 service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:42.298685 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1374/2731] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:42 2021] GET /identity/v3/auth/tokens => generated 3379 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:42.313327 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030a371-9aca-49fa-bf4d-51c7c820158b None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:42.372554 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030a371-9aca-49fa-bf4d-51c7c820158b None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:42.377102 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:42.377975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:42.378251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:42.378519 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] PATH_INFO: `/v3/users/75c9d86432ae4a6d92e01568766f6142` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:42.379682 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c9d86432ae4a6d92e01568766f6142)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:42.382333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:42.606892 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c9d86432ae4a6d92e01568766f6142'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:42.607533 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c9d86432ae4a6d92e01568766f6142'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:42.614044 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c9d86432ae4a6d92e01568766f6142'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:42.685261 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c9d86432ae4a6d92e01568766f6142'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:42.696853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c9d86432ae4a6d92e01568766f6142'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:42.702527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1358/2732] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:42 2021] DELETE /identity/v3/users/75c9d86432ae4a6d92e01568766f6142 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:42.706985 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877e262-7a8e-4671-9634-9c8aa8d4c53c None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:42.707510 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877e262-7a8e-4671-9634-9c8aa8d4c53c None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:42.707622 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877e262-7a8e-4671-9634-9c8aa8d4c53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:42.725157 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-5877e262-7a8e-4671-9634-9c8aa8d4c53c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:42.727001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5877e262-7a8e-4671-9634-9c8aa8d4c53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:42.781672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1375/2733] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:42.792186 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:42.793580 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:42.847927 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dcf25-972f-4195-8066-242dd5adf93f admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:42.852093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e5377-b954-40fd-bcc8-0fa6a688c7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:42.852722 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e5377-b954-40fd-bcc8-0fa6a688c7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:42.853000 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e5377-b954-40fd-bcc8-0fa6a688c7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:42.853274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e5377-b954-40fd-bcc8-0fa6a688c7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:42.862549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e5377-b954-40fd-bcc8-0fa6a688c7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:42.863934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e5377-b954-40fd-bcc8-0fa6a688c7d7 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:42.873699 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1359/2734] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:43.259399 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877e262-7a8e-4671-9634-9c8aa8d4c53c None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:43.260792 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5877e262-7a8e-4671-9634-9c8aa8d4c53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:43.272877 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877e262-7a8e-4671-9634-9c8aa8d4c53c None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:43.277477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b8b1b-0b69-42cf-a731-19272ff901ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:43.278364 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b8b1b-0b69-42cf-a731-19272ff901ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:43.278642 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b8b1b-0b69-42cf-a731-19272ff901ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:43.278919 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b8b1b-0b69-42cf-a731-19272ff901ca admin admin] PATH_INFO: `/v3/projects/c20ade65307e41de98f09b424612586b` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:43.280107 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b8b1b-0b69-42cf-a731-19272ff901ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20ade65307e41de98f09b424612586b)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:43.293832 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b8b1b-0b69-42cf-a731-19272ff901ca admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:43.393582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a23b8b1b-0b69-42cf-a731-19272ff901ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20ade65307e41de98f09b424612586b', 'request_id': 'req-a23b8b1b-0b69-42cf-a731-19272ff901ca'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:43.467679 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a23b8b1b-0b69-42cf-a731-19272ff901ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20ade65307e41de98f09b424612586b', 'request_id': 'req-a23b8b1b-0b69-42cf-a731-19272ff901ca'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:43.473502 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a23b8b1b-0b69-42cf-a731-19272ff901ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20ade65307e41de98f09b424612586b', 'request_id': 'req-a23b8b1b-0b69-42cf-a731-19272ff901ca'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:43.484819 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a23b8b1b-0b69-42cf-a731-19272ff901ca admin admin] The token cache is being invalidate because project c20ade65307e41de98f09b424612586b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:43.485106 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a23b8b1b-0b69-42cf-a731-19272ff901ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:43.485718 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-a23b8b1b-0b69-42cf-a731-19272ff901ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:43.487268 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1376/2735] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:43 2021] DELETE /identity/v3/projects/c20ade65307e41de98f09b424612586b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:43.493658 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d98cac-e613-48ab-870d-01536836899e None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:43.494157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d98cac-e613-48ab-870d-01536836899e None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:43.494255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d98cac-e613-48ab-870d-01536836899e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:43.512392 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-c2d98cac-e613-48ab-870d-01536836899e None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:43.513587 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-c2d98cac-e613-48ab-870d-01536836899e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:43.568900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1360/2736] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:43.577242 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99980d11-f13e-4102-a24a-bf5ef2acb7c0 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:43.577535 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99980d11-f13e-4102-a24a-bf5ef2acb7c0 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:43.577812 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99980d11-f13e-4102-a24a-bf5ef2acb7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:43.595910 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-99980d11-f13e-4102-a24a-bf5ef2acb7c0 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:43.597110 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-99980d11-f13e-4102-a24a-bf5ef2acb7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:43.605842 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1377/2737] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:44:43.609835 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d98cac-e613-48ab-870d-01536836899e None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:43.620119 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d98cac-e613-48ab-870d-01536836899e None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:43.624680 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341de030-c0ba-465b-8acd-ae650e0ec427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:43.625324 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341de030-c0ba-465b-8acd-ae650e0ec427 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:43.625601 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341de030-c0ba-465b-8acd-ae650e0ec427 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:43.625891 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341de030-c0ba-465b-8acd-ae650e0ec427 admin admin] PATH_INFO: `/v3/domains` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:43.626612 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341de030-c0ba-465b-8acd-ae650e0ec427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:44:43.626917 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341de030-c0ba-465b-8acd-ae650e0ec427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:43.628493 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341de030-c0ba-465b-8acd-ae650e0ec427 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:43.639494 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1361/2738] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:44:43.643568 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99980d11-f13e-4102-a24a-bf5ef2acb7c0 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:43.652671 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99980d11-f13e-4102-a24a-bf5ef2acb7c0 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:43.657165 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7ecfd-85b5-46d6-9051-265f02e90636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:43.657795 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7ecfd-85b5-46d6-9051-265f02e90636 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:43.658108 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7ecfd-85b5-46d6-9051-265f02e90636 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:43.658379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7ecfd-85b5-46d6-9051-265f02e90636 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:43.659051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7ecfd-85b5-46d6-9051-265f02e90636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:43.660917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7ecfd-85b5-46d6-9051-265f02e90636 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:43.749299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1378/2739] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:44:43 2021] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:43.753816 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341de030-c0ba-465b-8acd-ae650e0ec427 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:43.763615 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341de030-c0ba-465b-8acd-ae650e0ec427 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:43.817785 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd6b74-084c-4c64-9468-51e0b4d8d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:43.818464 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd6b74-084c-4c64-9468-51e0b4d8d054 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:43.818745 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd6b74-084c-4c64-9468-51e0b4d8d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:43.819007 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd6b74-084c-4c64-9468-51e0b4d8d054 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:43.819677 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd6b74-084c-4c64-9468-51e0b4d8d054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:43.821560 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd6b74-084c-4c64-9468-51e0b4d8d054 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:43.885445 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1362/2740] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:44:43 2021] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:43.890755 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7ecfd-85b5-46d6-9051-265f02e90636 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:43.901963 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7ecfd-85b5-46d6-9051-265f02e90636 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:43.906712 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8c31e-4454-4b6f-82ae-76569fdc6a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:43.907375 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8c31e-4454-4b6f-82ae-76569fdc6a44 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:43.907651 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8c31e-4454-4b6f-82ae-76569fdc6a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:43.907919 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8c31e-4454-4b6f-82ae-76569fdc6a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:43.908623 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8c31e-4454-4b6f-82ae-76569fdc6a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:43.910243 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8c31e-4454-4b6f-82ae-76569fdc6a44 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:43.921013 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1379/2741] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:43 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:44:43.924920 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd6b74-084c-4c64-9468-51e0b4d8d054 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:43.934812 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd6b74-084c-4c64-9468-51e0b4d8d054 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:43.939401 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dcb82-7c4c-4997-aadd-fff449bc3d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:43.940054 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dcb82-7c4c-4997-aadd-fff449bc3d78 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:43.940341 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dcb82-7c4c-4997-aadd-fff449bc3d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:43.940615 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dcb82-7c4c-4997-aadd-fff449bc3d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:43.941333 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dcb82-7c4c-4997-aadd-fff449bc3d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:43.942933 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dcb82-7c4c-4997-aadd-fff449bc3d78 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:43.952573 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1363/2742] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:43 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:44:43.956620 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8c31e-4454-4b6f-82ae-76569fdc6a44 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:43.967335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8c31e-4454-4b6f-82ae-76569fdc6a44 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:43.971895 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed613e48-7664-481f-a716-4e157ff8ccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:43.973011 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed613e48-7664-481f-a716-4e157ff8ccfd admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:43.973285 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed613e48-7664-481f-a716-4e157ff8ccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:43.973552 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed613e48-7664-481f-a716-4e157ff8ccfd admin admin] PATH_INFO: `/v3/projects/d68d0381061b4ed5bcb008818c2fff27/users/400081f6e86f4497a28387b70af94af2/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:43.988027 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed613e48-7664-481f-a716-4e157ff8ccfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68d0381061b4ed5bcb008818c2fff27, user_id=400081f6e86f4497a28387b70af94af2, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:43.990758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed613e48-7664-481f-a716-4e157ff8ccfd admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:44.061732 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1380/2743] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:43 2021] PUT /identity/v3/projects/d68d0381061b4ed5bcb008818c2fff27/users/400081f6e86f4497a28387b70af94af2/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:44.071835 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ca070-4b9e-4fc8-b2c1-862eb045d553 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:44.072121 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ca070-4b9e-4fc8-b2c1-862eb045d553 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:44.072393 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ca070-4b9e-4fc8-b2c1-862eb045d553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:44.098145 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-a33ca070-4b9e-4fc8-b2c1-862eb045d553 None None] MFA Rules not processed for user `400081f6e86f4497a28387b70af94af2`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:44.099325 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a33ca070-4b9e-4fc8-b2c1-862eb045d553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:44.159324 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1364/2744] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:44 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:44.164264 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed613e48-7664-481f-a716-4e157ff8ccfd admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:44.222135 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed613e48-7664-481f-a716-4e157ff8ccfd admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:44.227063 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57115293-0241-42a9-a655-d8b1353a5972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:44.227707 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57115293-0241-42a9-a655-d8b1353a5972 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:44.227991 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57115293-0241-42a9-a655-d8b1353a5972 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:44.228262 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57115293-0241-42a9-a655-d8b1353a5972 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:44.228939 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57115293-0241-42a9-a655-d8b1353a5972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:44.230873 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57115293-0241-42a9-a655-d8b1353a5972 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:44.297272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1381/2745] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:44:44 2021] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:44:44.301266 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ca070-4b9e-4fc8-b2c1-862eb045d553 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:44.311765 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ca070-4b9e-4fc8-b2c1-862eb045d553 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:44.370087 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91342f0-d821-4226-a708-d6e27630cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:44.370747 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91342f0-d821-4226-a708-d6e27630cdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:44.371028 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91342f0-d821-4226-a708-d6e27630cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:44.371303 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91342f0-d821-4226-a708-d6e27630cdb1 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:44.371985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91342f0-d821-4226-a708-d6e27630cdb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:44.373898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91342f0-d821-4226-a708-d6e27630cdb1 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:44.456684 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1365/2746] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:44:44 2021] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:44:44.461075 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57115293-0241-42a9-a655-d8b1353a5972 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:44.471065 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57115293-0241-42a9-a655-d8b1353a5972 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:44.475973 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb3818-8905-4199-99e7-fd932e24ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:44.476621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb3818-8905-4199-99e7-fd932e24ca17 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:44.476903 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb3818-8905-4199-99e7-fd932e24ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:44.477177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb3818-8905-4199-99e7-fd932e24ca17 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:44.477924 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb3818-8905-4199-99e7-fd932e24ca17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:44.479544 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb3818-8905-4199-99e7-fd932e24ca17 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:44.489718 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1382/2747] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:44 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:44.493718 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91342f0-d821-4226-a708-d6e27630cdb1 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:44.503547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91342f0-d821-4226-a708-d6e27630cdb1 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:44.508767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e9db0-012d-47ce-b1e5-99ab06ba50e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:44.509422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e9db0-012d-47ce-b1e5-99ab06ba50e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:44.509707 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e9db0-012d-47ce-b1e5-99ab06ba50e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:44.510018 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e9db0-012d-47ce-b1e5-99ab06ba50e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:44.510732 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e9db0-012d-47ce-b1e5-99ab06ba50e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:44.512287 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e9db0-012d-47ce-b1e5-99ab06ba50e3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:44.522424 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1366/2748] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:44 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:44:44.526327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb3818-8905-4199-99e7-fd932e24ca17 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:44.536500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb3818-8905-4199-99e7-fd932e24ca17 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:44.541589 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc82e3-391e-4303-8a3c-bcd1fcb72ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:44.542501 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc82e3-391e-4303-8a3c-bcd1fcb72ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:44.542781 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc82e3-391e-4303-8a3c-bcd1fcb72ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:44.543065 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc82e3-391e-4303-8a3c-bcd1fcb72ab0 admin admin] PATH_INFO: `/v3/projects/523ff17c718b49e98d8a18584912abb3/users/699e00ddc65d4ef1be1d024b52a39625/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:44.558545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc82e3-391e-4303-8a3c-bcd1fcb72ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=523ff17c718b49e98d8a18584912abb3, user_id=699e00ddc65d4ef1be1d024b52a39625, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:44.561459 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc82e3-391e-4303-8a3c-bcd1fcb72ab0 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:44.726518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1383/2749] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:44 2021] PUT /identity/v3/projects/523ff17c718b49e98d8a18584912abb3/users/699e00ddc65d4ef1be1d024b52a39625/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:44:44.736409 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf4095-4c77-48d8-b50f-a9bdda973527 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:44.736785 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf4095-4c77-48d8-b50f-a9bdda973527 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:44.737061 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf4095-4c77-48d8-b50f-a9bdda973527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:44.763888 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-badf4095-4c77-48d8-b50f-a9bdda973527 None None] MFA Rules not processed for user `699e00ddc65d4ef1be1d024b52a39625`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:44.765095 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-badf4095-4c77-48d8-b50f-a9bdda973527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:44.824855 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1367/2750] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:44 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:44.829541 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc82e3-391e-4303-8a3c-bcd1fcb72ab0 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:44.889401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc82e3-391e-4303-8a3c-bcd1fcb72ab0 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:44.894038 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea201ca-b36d-41dc-bd74-bc1ab14d5db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:44.894684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea201ca-b36d-41dc-bd74-bc1ab14d5db5 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:44.894965 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea201ca-b36d-41dc-bd74-bc1ab14d5db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:44.895238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea201ca-b36d-41dc-bd74-bc1ab14d5db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:44.896010 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea201ca-b36d-41dc-bd74-bc1ab14d5db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:44.897917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea201ca-b36d-41dc-bd74-bc1ab14d5db5 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:45.007067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1384/2751] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:44:44 2021] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:45.011022 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf4095-4c77-48d8-b50f-a9bdda973527 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:45.022242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf4095-4c77-48d8-b50f-a9bdda973527 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:45.076023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ff5c3-e658-4bbc-b08a-ff10f0b30359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:45.076683 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ff5c3-e658-4bbc-b08a-ff10f0b30359 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:45.076964 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ff5c3-e658-4bbc-b08a-ff10f0b30359 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:45.077240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ff5c3-e658-4bbc-b08a-ff10f0b30359 admin admin] PATH_INFO: `/v3/users` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:45.077953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ff5c3-e658-4bbc-b08a-ff10f0b30359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:45.079843 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ff5c3-e658-4bbc-b08a-ff10f0b30359 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:45.171359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1368/2752] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:44:45 2021] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:45.175336 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea201ca-b36d-41dc-bd74-bc1ab14d5db5 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:45.186321 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea201ca-b36d-41dc-bd74-bc1ab14d5db5 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:45.190940 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb6737-844a-4dfb-9ca6-9762440f2b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:45.191588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb6737-844a-4dfb-9ca6-9762440f2b9a admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:45.191869 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb6737-844a-4dfb-9ca6-9762440f2b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:45.192144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb6737-844a-4dfb-9ca6-9762440f2b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:45.192859 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb6737-844a-4dfb-9ca6-9762440f2b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:45.194532 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb6737-844a-4dfb-9ca6-9762440f2b9a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:45.204778 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1385/2753] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:45.208761 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ff5c3-e658-4bbc-b08a-ff10f0b30359 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:45.221373 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ff5c3-e658-4bbc-b08a-ff10f0b30359 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:45.223415 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da63c89-c311-4ee7-9e41-fb4a10ea9f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:45.224306 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da63c89-c311-4ee7-9e41-fb4a10ea9f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:45.224582 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da63c89-c311-4ee7-9e41-fb4a10ea9f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:45.225639 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da63c89-c311-4ee7-9e41-fb4a10ea9f8e admin admin] PATH_INFO: `/v3/projects/7d36067466fc4aa28c7f9ef9e0bc2b40/users/b99000c7a9944c1096f766df5afde0c3/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:45.241403 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da63c89-c311-4ee7-9e41-fb4a10ea9f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d36067466fc4aa28c7f9ef9e0bc2b40, user_id=b99000c7a9944c1096f766df5afde0c3, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:45.244074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da63c89-c311-4ee7-9e41-fb4a10ea9f8e admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:45.308259 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1369/2754] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:45 2021] PUT /identity/v3/projects/7d36067466fc4aa28c7f9ef9e0bc2b40/users/b99000c7a9944c1096f766df5afde0c3/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:45.312209 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb6737-844a-4dfb-9ca6-9762440f2b9a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:45.322199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb6737-844a-4dfb-9ca6-9762440f2b9a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:45.376270 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17196066-3d43-4d0c-90d4-9a9c1d15465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:45.376928 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17196066-3d43-4d0c-90d4-9a9c1d15465e admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:45.377210 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17196066-3d43-4d0c-90d4-9a9c1d15465e admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:45.377484 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17196066-3d43-4d0c-90d4-9a9c1d15465e admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:45.378226 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17196066-3d43-4d0c-90d4-9a9c1d15465e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:45.379817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17196066-3d43-4d0c-90d4-9a9c1d15465e admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:45.389061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1386/2755] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:45 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:45.393369 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da63c89-c311-4ee7-9e41-fb4a10ea9f8e admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:45.404157 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da63c89-c311-4ee7-9e41-fb4a10ea9f8e admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:45.408756 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a472a-efbf-4874-a57a-2ca37d656a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:45.409615 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a472a-efbf-4874-a57a-2ca37d656a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:45.409918 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a472a-efbf-4874-a57a-2ca37d656a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:45.410197 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a472a-efbf-4874-a57a-2ca37d656a72 admin admin] PATH_INFO: `/v3/projects/7d36067466fc4aa28c7f9ef9e0bc2b40/users/b99000c7a9944c1096f766df5afde0c3/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:45.412147 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a472a-efbf-4874-a57a-2ca37d656a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d36067466fc4aa28c7f9ef9e0bc2b40, user_id=b99000c7a9944c1096f766df5afde0c3, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:45.415367 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a472a-efbf-4874-a57a-2ca37d656a72 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:45.425329 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1370/2756] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:45 2021] PUT /identity/v3/projects/7d36067466fc4aa28c7f9ef9e0bc2b40/users/b99000c7a9944c1096f766df5afde0c3/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:44:45.436412 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ac966-95f9-4b0a-814e-e330bba4b247 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:45.437195 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ac966-95f9-4b0a-814e-e330bba4b247 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:45.437195 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ac966-95f9-4b0a-814e-e330bba4b247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:45.464270 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-3c1ac966-95f9-4b0a-814e-e330bba4b247 None None] MFA Rules not processed for user `b99000c7a9944c1096f766df5afde0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:45.468438 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3c1ac966-95f9-4b0a-814e-e330bba4b247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:45.532827 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1387/2757] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:45 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:45.543688 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a472a-efbf-4874-a57a-2ca37d656a72 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:45.545344 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-239a472a-efbf-4874-a57a-2ca37d656a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:45.601148 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a472a-efbf-4874-a57a-2ca37d656a72 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:45.604856 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba89f9-b968-4c90-b3a2-b82046cb9c50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:45.605489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba89f9-b968-4c90-b3a2-b82046cb9c50 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:45.605767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba89f9-b968-4c90-b3a2-b82046cb9c50 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:45.606074 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba89f9-b968-4c90-b3a2-b82046cb9c50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:45.660572 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba89f9-b968-4c90-b3a2-b82046cb9c50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:45.662024 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba89f9-b968-4c90-b3a2-b82046cb9c50 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:45.671245 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1371/2758] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:45 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:47.665174 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ac966-95f9-4b0a-814e-e330bba4b247 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:47.666669 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3c1ac966-95f9-4b0a-814e-e330bba4b247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:47.679003 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ac966-95f9-4b0a-814e-e330bba4b247 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:47.682599 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881b039-c33f-4d5a-a161-386a4b43852b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:47.683261 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881b039-c33f-4d5a-a161-386a4b43852b service cinder] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:47.683545 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881b039-c33f-4d5a-a161-386a4b43852b service cinder] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:47.683822 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881b039-c33f-4d5a-a161-386a4b43852b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:47.741167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881b039-c33f-4d5a-a161-386a4b43852b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:47.742651 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881b039-c33f-4d5a-a161-386a4b43852b service cinder] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:47.751580 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1388/2759] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:47 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:49.072775 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba89f9-b968-4c90-b3a2-b82046cb9c50 service cinder] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:49.081518 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba89f9-b968-4c90-b3a2-b82046cb9c50 service cinder] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:49.085190 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d17ec0-ef75-46cd-9c7f-9df144bdfac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca81ff9c3114e8c9379418956063bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:49.085813 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d17ec0-ef75-46cd-9c7f-9df144bdfac7 service cinder] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:49.086119 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d17ec0-ef75-46cd-9c7f-9df144bdfac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:49.086392 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d17ec0-ef75-46cd-9c7f-9df144bdfac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:49.094964 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d17ec0-ef75-46cd-9c7f-9df144bdfac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:49.099233 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d17ec0-ef75-46cd-9c7f-9df144bdfac7 service cinder] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:49.106120 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1372/2760] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:49 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:53.792761 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881b039-c33f-4d5a-a161-386a4b43852b service cinder] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:53.851721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881b039-c33f-4d5a-a161-386a4b43852b service cinder] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:53.856192 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:53.857051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:53.857330 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:53.857601 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] PATH_INFO: `/v3/users/400081f6e86f4497a28387b70af94af2` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:53.858793 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] RBAC: Authorizing `identity:delete_user(user_id=400081f6e86f4497a28387b70af94af2)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:53.860727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:54.110591 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400081f6e86f4497a28387b70af94af2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:54.111234 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400081f6e86f4497a28387b70af94af2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:54.111830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400081f6e86f4497a28387b70af94af2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:54.205370 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400081f6e86f4497a28387b70af94af2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:54.217424 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400081f6e86f4497a28387b70af94af2'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:54.229848 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1389/2761] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:53 2021] DELETE /identity/v3/users/400081f6e86f4497a28387b70af94af2 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:54.234338 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614b2b8-b5ab-4cc6-ba24-733abad7d61c None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:54.234796 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614b2b8-b5ab-4cc6-ba24-733abad7d61c None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:54.234914 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614b2b8-b5ab-4cc6-ba24-733abad7d61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:54.252806 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-e614b2b8-b5ab-4cc6-ba24-733abad7d61c None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:54.254089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e614b2b8-b5ab-4cc6-ba24-733abad7d61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:54.309391 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1373/2762] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:54.322916 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:54.324334 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:54.379320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353c50d-9137-4ac0-816b-3836f359420a admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:54.383054 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616b347-fd36-43af-a57c-225d043b719a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:54.383692 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b347-fd36-43af-a57c-225d043b719a service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:54.383971 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b347-fd36-43af-a57c-225d043b719a service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:54.384241 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b347-fd36-43af-a57c-225d043b719a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:54.392907 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616b347-fd36-43af-a57c-225d043b719a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:54.394370 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616b347-fd36-43af-a57c-225d043b719a service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:54.404263 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1390/2763] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:44:54.836058 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614b2b8-b5ab-4cc6-ba24-733abad7d61c None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:54.838274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-e614b2b8-b5ab-4cc6-ba24-733abad7d61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:54.850172 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614b2b8-b5ab-4cc6-ba24-733abad7d61c None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:54.855323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:54.856195 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:54.856474 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:54.856764 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] PATH_INFO: `/v3/projects/d68d0381061b4ed5bcb008818c2fff27` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:54.858308 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d68d0381061b4ed5bcb008818c2fff27)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:54.859942 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:54.960334 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68d0381061b4ed5bcb008818c2fff27', 'request_id': 'req-3afc2c9c-5adf-44d2-a422-b5833e39ef64'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:55.057243 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68d0381061b4ed5bcb008818c2fff27', 'request_id': 'req-3afc2c9c-5adf-44d2-a422-b5833e39ef64'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:55.062908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68d0381061b4ed5bcb008818c2fff27', 'request_id': 'req-3afc2c9c-5adf-44d2-a422-b5833e39ef64'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:55.074023 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] The token cache is being invalidate because project d68d0381061b4ed5bcb008818c2fff27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:55.077908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:55.077908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:55.077908 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1374/2764] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:54 2021] DELETE /identity/v3/projects/d68d0381061b4ed5bcb008818c2fff27 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:44:55.080320 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616b347-fd36-43af-a57c-225d043b719a service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:55.090619 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616b347-fd36-43af-a57c-225d043b719a service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:55.145518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:55.146557 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:55.146841 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:55.147222 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] PATH_INFO: `/v3/users/699e00ddc65d4ef1be1d024b52a39625` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:55.148400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=699e00ddc65d4ef1be1d024b52a39625)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:55.151060 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:55.389880 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699e00ddc65d4ef1be1d024b52a39625'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:55.390533 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699e00ddc65d4ef1be1d024b52a39625'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:55.391130 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699e00ddc65d4ef1be1d024b52a39625'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:55.462758 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699e00ddc65d4ef1be1d024b52a39625'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:55.475051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699e00ddc65d4ef1be1d024b52a39625'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:55.487283 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1391/2765] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:55 2021] DELETE /identity/v3/users/699e00ddc65d4ef1be1d024b52a39625 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:44:55.886548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:55.888081 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:55.901546 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc2c9c-5adf-44d2-a422-b5833e39ef64 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:55.956597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:55.957455 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:55.957734 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:55.958045 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] PATH_INFO: `/v3/projects/523ff17c718b49e98d8a18584912abb3` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:55.959218 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=523ff17c718b49e98d8a18584912abb3)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:55.961104 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:56.062037 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523ff17c718b49e98d8a18584912abb3', 'request_id': 'req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:56.125259 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523ff17c718b49e98d8a18584912abb3', 'request_id': 'req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:56.130899 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523ff17c718b49e98d8a18584912abb3', 'request_id': 'req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:56.141836 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] The token cache is being invalidate because project 523ff17c718b49e98d8a18584912abb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:56.142148 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:56.143778 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:56.144284 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1375/2766] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:55 2021] DELETE /identity/v3/projects/523ff17c718b49e98d8a18584912abb3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:56.148286 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:56.149798 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:56.162893 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34a315-84ef-4755-a66a-9aaf7e429c8d admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:56.216774 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225d3f2-d924-4a28-91a2-3d5c07ae1a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:56.217630 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225d3f2-d924-4a28-91a2-3d5c07ae1a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:56.217942 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225d3f2-d924-4a28-91a2-3d5c07ae1a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:56.218214 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225d3f2-d924-4a28-91a2-3d5c07ae1a51 admin admin] PATH_INFO: `/v3/users/b99000c7a9944c1096f766df5afde0c3` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:56.219460 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225d3f2-d924-4a28-91a2-3d5c07ae1a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99000c7a9944c1096f766df5afde0c3)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:56.221402 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225d3f2-d924-4a28-91a2-3d5c07ae1a51 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:56.372667 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-8225d3f2-d924-4a28-91a2-3d5c07ae1a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99000c7a9944c1096f766df5afde0c3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:56.373427 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-8225d3f2-d924-4a28-91a2-3d5c07ae1a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99000c7a9944c1096f766df5afde0c3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:56.374049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-8225d3f2-d924-4a28-91a2-3d5c07ae1a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99000c7a9944c1096f766df5afde0c3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:56.445341 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-8225d3f2-d924-4a28-91a2-3d5c07ae1a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99000c7a9944c1096f766df5afde0c3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:56.457496 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-8225d3f2-d924-4a28-91a2-3d5c07ae1a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99000c7a9944c1096f766df5afde0c3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:56.469765 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1392/2767] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:44:56 2021] DELETE /identity/v3/users/b99000c7a9944c1096f766df5afde0c3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:56.864208 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:56.865631 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:56.878520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007efe9f-6957-4e1e-af9e-2c9f9dfac0ce admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:56.932900 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:56.933752 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:56.934066 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:56.934343 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80 admin admin] PATH_INFO: `/v3/projects/7d36067466fc4aa28c7f9ef9e0bc2b40` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:56.935548 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d36067466fc4aa28c7f9ef9e0bc2b40)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:56.937442 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:57.074622 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d36067466fc4aa28c7f9ef9e0bc2b40', 'request_id': 'req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:57.176777 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d36067466fc4aa28c7f9ef9e0bc2b40', 'request_id': 'req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:57.183371 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d36067466fc4aa28c7f9ef9e0bc2b40', 'request_id': 'req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:57.194168 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80 admin admin] The token cache is being invalidate because project 7d36067466fc4aa28c7f9ef9e0bc2b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:44:57.194456 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:57.195075 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-304dc609-fd0d-44c1-94df-0d8a1bdf2e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:44:57.196589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1376/2768] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:44:56 2021] DELETE /identity/v3/projects/7d36067466fc4aa28c7f9ef9e0bc2b40 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:44:57.204178 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe20af3-6f35-4412-9ac8-068c88b61a76 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:57.208624 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe20af3-6f35-4412-9ac8-068c88b61a76 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:57.208624 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe20af3-6f35-4412-9ac8-068c88b61a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:57.223433 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-7fe20af3-6f35-4412-9ac8-068c88b61a76 None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:57.224625 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7fe20af3-6f35-4412-9ac8-068c88b61a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:57.287694 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1393/2769] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:57.296410 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5d5c4-c221-4d78-bc18-5e1c316a5ecc None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:57.296698 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5d5c4-c221-4d78-bc18-5e1c316a5ecc None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:57.296975 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5d5c4-c221-4d78-bc18-5e1c316a5ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:57.315152 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-8fd5d5c4-c221-4d78-bc18-5e1c316a5ecc None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:57.316342 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8fd5d5c4-c221-4d78-bc18-5e1c316a5ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:57.324090 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1377/2770] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:44:57.328259 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe20af3-6f35-4412-9ac8-068c88b61a76 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:57.337633 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe20af3-6f35-4412-9ac8-068c88b61a76 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:57.342558 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae6c49-1c46-4bb6-9980-eee9fb1870b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:57.343195 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae6c49-1c46-4bb6-9980-eee9fb1870b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:57.343472 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae6c49-1c46-4bb6-9980-eee9fb1870b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:57.343743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae6c49-1c46-4bb6-9980-eee9fb1870b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:57.344448 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae6c49-1c46-4bb6-9980-eee9fb1870b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 14:44:57.344749 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae6c49-1c46-4bb6-9980-eee9fb1870b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:57.346369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae6c49-1c46-4bb6-9980-eee9fb1870b4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:57.358304 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1394/2771] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Aug 29 14:44:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 14:44:57.362425 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5d5c4-c221-4d78-bc18-5e1c316a5ecc None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:57.371874 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5d5c4-c221-4d78-bc18-5e1c316a5ecc None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:57.376502 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306448e-5503-4ab0-9993-12ed9eacc758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:57.377136 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306448e-5503-4ab0-9993-12ed9eacc758 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:57.377420 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306448e-5503-4ab0-9993-12ed9eacc758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:57.377686 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306448e-5503-4ab0-9993-12ed9eacc758 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:57.378404 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306448e-5503-4ab0-9993-12ed9eacc758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:57.380293 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306448e-5503-4ab0-9993-12ed9eacc758 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:57.486876 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1378/2772] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:44:57 2021] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:44:57.490890 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae6c49-1c46-4bb6-9980-eee9fb1870b4 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:57.501536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae6c49-1c46-4bb6-9980-eee9fb1870b4 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:57.555873 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239d683-25aa-4ae4-b2eb-1ac6e11c7186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:57.556538 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239d683-25aa-4ae4-b2eb-1ac6e11c7186 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:57.556823 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239d683-25aa-4ae4-b2eb-1ac6e11c7186 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:57.557743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239d683-25aa-4ae4-b2eb-1ac6e11c7186 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:57.558480 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239d683-25aa-4ae4-b2eb-1ac6e11c7186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:57.560401 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239d683-25aa-4ae4-b2eb-1ac6e11c7186 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:57.657456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1395/2773] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:44:57 2021] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 14:44:57.661599 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306448e-5503-4ab0-9993-12ed9eacc758 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:57.672513 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306448e-5503-4ab0-9993-12ed9eacc758 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:57.677192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b35da6-b6d8-4665-ba02-9fae8d26d3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:57.677885 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b35da6-b6d8-4665-ba02-9fae8d26d3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:57.678189 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b35da6-b6d8-4665-ba02-9fae8d26d3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:57.678487 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b35da6-b6d8-4665-ba02-9fae8d26d3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:57.679210 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b35da6-b6d8-4665-ba02-9fae8d26d3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:57.680814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b35da6-b6d8-4665-ba02-9fae8d26d3a3 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:57.691246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1379/2774] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:44:57.694955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239d683-25aa-4ae4-b2eb-1ac6e11c7186 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:57.706435 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239d683-25aa-4ae4-b2eb-1ac6e11c7186 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:57.714177 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e6fb8-64f8-4b07-bbcd-01d9e76b0e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:57.714838 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e6fb8-64f8-4b07-bbcd-01d9e76b0e08 admin admin] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:57.715117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e6fb8-64f8-4b07-bbcd-01d9e76b0e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:57.715388 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e6fb8-64f8-4b07-bbcd-01d9e76b0e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:57.716126 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e6fb8-64f8-4b07-bbcd-01d9e76b0e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:57.717733 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e6fb8-64f8-4b07-bbcd-01d9e76b0e08 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:57.727917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1396/2775] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:44:57 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:44:57.732673 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b35da6-b6d8-4665-ba02-9fae8d26d3a3 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:57.742440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b35da6-b6d8-4665-ba02-9fae8d26d3a3 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:57.747043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad73d7-cb7e-48c0-9528-168c249f58d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:57.747903 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad73d7-cb7e-48c0-9528-168c249f58d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:57.748183 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad73d7-cb7e-48c0-9528-168c249f58d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:57.748459 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad73d7-cb7e-48c0-9528-168c249f58d9 admin admin] PATH_INFO: `/v3/projects/a000df0ea44b455795a3f49fdbbbbd1c/users/1942620c43074465ac1304b4760f6526/roles/8f6eaa48bff44ea8822a222e38de2feb` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:57.762301 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad73d7-cb7e-48c0-9528-168c249f58d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a000df0ea44b455795a3f49fdbbbbd1c, user_id=1942620c43074465ac1304b4760f6526, role_id=8f6eaa48bff44ea8822a222e38de2feb)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:57.764922 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad73d7-cb7e-48c0-9528-168c249f58d9 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:57.827408 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1380/2776] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:44:57 2021] PUT /identity/v3/projects/a000df0ea44b455795a3f49fdbbbbd1c/users/1942620c43074465ac1304b4760f6526/roles/8f6eaa48bff44ea8822a222e38de2feb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 14:44:57.832440 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709b7e6-0711-4bbc-b241-a56e1f890c8b None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:57.832727 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709b7e6-0711-4bbc-b241-a56e1f890c8b None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:57.833001 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709b7e6-0711-4bbc-b241-a56e1f890c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:57.851139 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-7709b7e6-0711-4bbc-b241-a56e1f890c8b None None] MFA Rules not processed for user `a0f8f7fa57374efdb2df20708faea2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:44:57.852313 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7709b7e6-0711-4bbc-b241-a56e1f890c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:57.909134 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1397/2777] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:44:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:44:57.919888 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad73d7-cb7e-48c0-9528-168c249f58d9 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:44:57.921547 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-3aad73d7-cb7e-48c0-9528-168c249f58d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:44:57.977399 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad73d7-cb7e-48c0-9528-168c249f58d9 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:44:57.981315 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a220ad-966f-4874-a704-07e529d4cd2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:44:57.981987 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a220ad-966f-4874-a704-07e529d4cd2f service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:44:57.982270 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a220ad-966f-4874-a704-07e529d4cd2f service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:44:57.982546 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a220ad-966f-4874-a704-07e529d4cd2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:44:57.991305 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a220ad-966f-4874-a704-07e529d4cd2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:44:57.992729 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a220ad-966f-4874-a704-07e529d4cd2f service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:44:58.002563 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1381/2778] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:44:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:45:03.079572 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d755e3-b1cd-4a0f-9f1b-d30f4b5e12eb None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:03.080117 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d755e3-b1cd-4a0f-9f1b-d30f4b5e12eb None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:03.082047 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d755e3-b1cd-4a0f-9f1b-d30f4b5e12eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:03.123582 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-78d755e3-b1cd-4a0f-9f1b-d30f4b5e12eb None None] MFA Rules not processed for user `1942620c43074465ac1304b4760f6526`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:45:03.124964 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-78d755e3-b1cd-4a0f-9f1b-d30f4b5e12eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:03.207159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1398/2779] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:45:03 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 14:45:03.211374 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a220ad-966f-4874-a704-07e529d4cd2f service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:03.224489 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a220ad-966f-4874-a704-07e529d4cd2f service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:03.233377 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d46fb-c2ba-40d0-81a7-365b12931a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:03.234079 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d46fb-c2ba-40d0-81a7-365b12931a17 admin admin] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:03.234358 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d46fb-c2ba-40d0-81a7-365b12931a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:03.234629 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d46fb-c2ba-40d0-81a7-365b12931a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:03.235326 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d46fb-c2ba-40d0-81a7-365b12931a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:03.237211 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d46fb-c2ba-40d0-81a7-365b12931a17 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:03.329745 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1382/2780] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Aug 29 14:45:03 2021] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:45:03.333743 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d755e3-b1cd-4a0f-9f1b-d30f4b5e12eb None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:03.349049 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d755e3-b1cd-4a0f-9f1b-d30f4b5e12eb None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:03.420318 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e69a-d132-4b1c-9968-bd55929991b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:03.420921 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e69a-d132-4b1c-9968-bd55929991b7 admin admin] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:03.421202 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e69a-d132-4b1c-9968-bd55929991b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:03.421488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e69a-d132-4b1c-9968-bd55929991b7 admin admin] PATH_INFO: `/v3/users` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:03.422235 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26e69a-d132-4b1c-9968-bd55929991b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:03.424151 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26e69a-d132-4b1c-9968-bd55929991b7 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:03.532574 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1399/2781] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Aug 29 14:45:03 2021] POST /identity/v3/users => generated 295 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 14:45:03.536467 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d46fb-c2ba-40d0-81a7-365b12931a17 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:03.549300 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d46fb-c2ba-40d0-81a7-365b12931a17 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:03.558767 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb9f7e-8262-4cb1-9e3c-77d656d9c97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:03.559409 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb9f7e-8262-4cb1-9e3c-77d656d9c97c admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:03.559693 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb9f7e-8262-4cb1-9e3c-77d656d9c97c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:03.559973 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb9f7e-8262-4cb1-9e3c-77d656d9c97c admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:03.560917 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb9f7e-8262-4cb1-9e3c-77d656d9c97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:03.562807 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb9f7e-8262-4cb1-9e3c-77d656d9c97c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:03.575036 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1383/2782] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:45:03 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 14:45:03.579155 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e69a-d132-4b1c-9968-bd55929991b7 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:03.590739 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e69a-d132-4b1c-9968-bd55929991b7 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:03.596525 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa9156-3716-41e3-9ba1-3852691f6316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:03.597817 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9156-3716-41e3-9ba1-3852691f6316 admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:03.598284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9156-3716-41e3-9ba1-3852691f6316 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:03.598656 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9156-3716-41e3-9ba1-3852691f6316 admin admin] PATH_INFO: `/v3/projects/443082d158ca4e1cb0a8e677212e3f7f/users/7e6f97e029004028b0b8f91789b5ef9b/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:03.616338 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa9156-3716-41e3-9ba1-3852691f6316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=443082d158ca4e1cb0a8e677212e3f7f, user_id=7e6f97e029004028b0b8f91789b5ef9b, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:03.620550 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa9156-3716-41e3-9ba1-3852691f6316 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:03.732998 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1400/2783] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:45:03 2021] PUT /identity/v3/projects/443082d158ca4e1cb0a8e677212e3f7f/users/7e6f97e029004028b0b8f91789b5ef9b/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:45:03.736822 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb9f7e-8262-4cb1-9e3c-77d656d9c97c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:03.747619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb9f7e-8262-4cb1-9e3c-77d656d9c97c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:03.806597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e76a5-048e-4c1f-b9dc-60f068a17bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:03.808603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e76a5-048e-4c1f-b9dc-60f068a17bec admin admin] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:03.808603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e76a5-048e-4c1f-b9dc-60f068a17bec admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:03.808603 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e76a5-048e-4c1f-b9dc-60f068a17bec admin admin] PATH_INFO: `/v3/roles` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:03.809561 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e76a5-048e-4c1f-b9dc-60f068a17bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:03.811240 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e76a5-048e-4c1f-b9dc-60f068a17bec admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:03.823768 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1384/2784] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Aug 29 14:45:03 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 14:45:03.827138 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa9156-3716-41e3-9ba1-3852691f6316 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:03.839029 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa9156-3716-41e3-9ba1-3852691f6316 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:03.844299 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2348c5-e203-4da2-b092-1f0057c2d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:03.845179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2348c5-e203-4da2-b092-1f0057c2d21b admin admin] REQUEST_METHOD: `PUT` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:03.845524 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2348c5-e203-4da2-b092-1f0057c2d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:03.846327 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2348c5-e203-4da2-b092-1f0057c2d21b admin admin] PATH_INFO: `/v3/projects/443082d158ca4e1cb0a8e677212e3f7f/users/7e6f97e029004028b0b8f91789b5ef9b/roles/4f40e52fa1fb462582ae0be8805efce6` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:03.848254 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2348c5-e203-4da2-b092-1f0057c2d21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=443082d158ca4e1cb0a8e677212e3f7f, user_id=7e6f97e029004028b0b8f91789b5ef9b, role_id=4f40e52fa1fb462582ae0be8805efce6)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:03.851022 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2348c5-e203-4da2-b092-1f0057c2d21b admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:03.862849 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1401/2785] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Aug 29 14:45:03 2021] PUT /identity/v3/projects/443082d158ca4e1cb0a8e677212e3f7f/users/7e6f97e029004028b0b8f91789b5ef9b/roles/4f40e52fa1fb462582ae0be8805efce6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:45:09.255789 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9f1d5-f17f-4064-b45e-db4d2d353d7a None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:09.256233 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9f1d5-f17f-4064-b45e-db4d2d353d7a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:09.256481 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9f1d5-f17f-4064-b45e-db4d2d353d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:09.289512 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-61b9f1d5-f17f-4064-b45e-db4d2d353d7a None None] MFA Rules not processed for user `7e6f97e029004028b0b8f91789b5ef9b`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:45:09.290671 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-61b9f1d5-f17f-4064-b45e-db4d2d353d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:09.385021 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1385/2786] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:45:09 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:45:09.394511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2348c5-e203-4da2-b092-1f0057c2d21b admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:09.396275 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-df2348c5-e203-4da2-b092-1f0057c2d21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:09.471861 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2348c5-e203-4da2-b092-1f0057c2d21b admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:09.477996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5f2e5-1dbb-4c29-a967-ecf85ff90111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:09.479721 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5f2e5-1dbb-4c29-a967-ecf85ff90111 service nova] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:09.480009 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5f2e5-1dbb-4c29-a967-ecf85ff90111 service nova] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:09.480281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5f2e5-1dbb-4c29-a967-ecf85ff90111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:09.536941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5f2e5-1dbb-4c29-a967-ecf85ff90111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:09.538592 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5f2e5-1dbb-4c29-a967-ecf85ff90111 service nova] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:09.554487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1402/2787] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:45:09 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:45:25.209913 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a891b-9022-4e8d-a4ae-70e20b60e755 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:25.210451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a891b-9022-4e8d-a4ae-70e20b60e755 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:25.210451 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a891b-9022-4e8d-a4ae-70e20b60e755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:25.228484 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-024a891b-9022-4e8d-a4ae-70e20b60e755 None None] MFA Rules not processed for user `afee50dd81e5484081d4aef1c119a129`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:45:25.229689 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-024a891b-9022-4e8d-a4ae-70e20b60e755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:25.281821 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1386/2788] 10.222.0.16 () {58 vars in 968 bytes} [Sun Aug 29 14:45:25 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:45:25.327404 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5f2e5-1dbb-4c29-a967-ecf85ff90111 service nova] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:25.328840 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-44b5f2e5-1dbb-4c29-a967-ecf85ff90111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:25.400482 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5f2e5-1dbb-4c29-a967-ecf85ff90111 service nova] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:25.405450 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a81b9-2746-44f2-adc1-c879c72b5cd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37041a9727e4ab6a5c52b00327e7a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:25.406112 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a81b9-2746-44f2-adc1-c879c72b5cd8 service swift] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:25.406391 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a81b9-2746-44f2-adc1-c879c72b5cd8 service swift] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:25.406654 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a81b9-2746-44f2-adc1-c879c72b5cd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:25.414353 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a81b9-2746-44f2-adc1-c879c72b5cd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:25.415914 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a81b9-2746-44f2-adc1-c879c72b5cd8 service swift] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:25.425176 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1403/2789] 10.222.0.16 () {60 vars in 1385 bytes} [Sun Aug 29 14:45:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 14:45:29.934567 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3682c-e249-4179-9b14-939aff80503a None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:29.935192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3682c-e249-4179-9b14-939aff80503a None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:29.935192 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3682c-e249-4179-9b14-939aff80503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:29.952805 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-bfe3682c-e249-4179-9b14-939aff80503a None None] MFA Rules not processed for user `1942620c43074465ac1304b4760f6526`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:45:29.954690 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-bfe3682c-e249-4179-9b14-939aff80503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:29.961103 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1387/2790] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:45:29 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:45:33.568489 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a81b9-2746-44f2-adc1-c879c72b5cd8 service swift] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:33.570081 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-6e4a81b9-2746-44f2-adc1-c879c72b5cd8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:33.650738 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a81b9-2746-44f2-adc1-c879c72b5cd8 service swift] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:33.655511 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:33.656403 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:33.656686 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:33.656960 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] PATH_INFO: `/v3/users/c1a6ff2d8f214df9810da0000bfe9e79` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:33.658164 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a6ff2d8f214df9810da0000bfe9e79)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:33.660144 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:33.866637 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a6ff2d8f214df9810da0000bfe9e79'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:33.867397 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a6ff2d8f214df9810da0000bfe9e79'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:33.868006 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a6ff2d8f214df9810da0000bfe9e79'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:33.936307 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a6ff2d8f214df9810da0000bfe9e79'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:33.948557 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a6ff2d8f214df9810da0000bfe9e79'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:33.961763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1404/2791] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:45:33 2021] DELETE /identity/v3/users/c1a6ff2d8f214df9810da0000bfe9e79 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:45:34.224926 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3682c-e249-4179-9b14-939aff80503a None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:34.239251 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3682c-e249-4179-9b14-939aff80503a None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:34.299882 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:34.300848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:34.301201 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:34.301552 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] PATH_INFO: `/v3/projects/50e1e30ed1d34a3095da54288e159f79` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:34.302846 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e1e30ed1d34a3095da54288e159f79)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:34.304848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:34.408530 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e1e30ed1d34a3095da54288e159f79', 'request_id': 'req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:34.479354 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e1e30ed1d34a3095da54288e159f79', 'request_id': 'req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:34.491101 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e1e30ed1d34a3095da54288e159f79', 'request_id': 'req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:34.506654 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] The token cache is being invalidate because project 50e1e30ed1d34a3095da54288e159f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:45:34.507413 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:34.508259 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:34.514564 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1388/2792] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:45:34 2021] DELETE /identity/v3/projects/50e1e30ed1d34a3095da54288e159f79 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:45:34.515066 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:34.516684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:34.540357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a424d-d165-4c4a-a555-fe696f005ec6 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:34.599940 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:34.600819 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:34.601102 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:34.601379 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] PATH_INFO: `/v3/users/e23dd5b9e58f4060b3cd1e53a2b91fa3` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:34.602762 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e23dd5b9e58f4060b3cd1e53a2b91fa3)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:34.604503 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:34.849807 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e23dd5b9e58f4060b3cd1e53a2b91fa3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:34.850500 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e23dd5b9e58f4060b3cd1e53a2b91fa3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:34.851199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e23dd5b9e58f4060b3cd1e53a2b91fa3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:34.930879 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e23dd5b9e58f4060b3cd1e53a2b91fa3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:34.944005 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e23dd5b9e58f4060b3cd1e53a2b91fa3'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:34.957367 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1405/2793] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:45:34 2021] DELETE /identity/v3/users/e23dd5b9e58f4060b3cd1e53a2b91fa3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:45:35.224495 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:35.226043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:35.240527 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51464bd1-ea39-4bcb-85dc-60bdc194c3ca admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:35.297722 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:35.298611 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:35.298895 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:35.299235 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] PATH_INFO: `/v3/projects/5bdb3a934c224eafb85968cce7cdf3e4` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:35.300653 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bdb3a934c224eafb85968cce7cdf3e4)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:35.302662 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:35.500879 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bdb3a934c224eafb85968cce7cdf3e4', 'request_id': 'req-d42c285f-e457-4f35-a9d0-a94aee3cd60c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:35.599112 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bdb3a934c224eafb85968cce7cdf3e4', 'request_id': 'req-d42c285f-e457-4f35-a9d0-a94aee3cd60c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:35.605247 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bdb3a934c224eafb85968cce7cdf3e4', 'request_id': 'req-d42c285f-e457-4f35-a9d0-a94aee3cd60c'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:35.617041 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] The token cache is being invalidate because project 5bdb3a934c224eafb85968cce7cdf3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:45:35.617323 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:35.618311 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:35.619884 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1389/2794] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:45:35 2021] DELETE /identity/v3/projects/5bdb3a934c224eafb85968cce7cdf3e4 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:45:46.039885 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:46.041247 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:46.041660 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:46.042821 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:46.118930 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b63daa-dc0f-4035-8efe-33fde364556f admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:46.120770 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c285f-e457-4f35-a9d0-a94aee3cd60c admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:46.126524 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d08444-7b1b-4825-85de-4a4601fbe2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:46.127179 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d08444-7b1b-4825-85de-4a4601fbe2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:46.127458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d08444-7b1b-4825-85de-4a4601fbe2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:46.127728 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d08444-7b1b-4825-85de-4a4601fbe2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:46.129758 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d3a47-c939-4dac-8afd-ae44ec1c951a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:46.130559 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3a47-c939-4dac-8afd-ae44ec1c951a service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:46.130839 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3a47-c939-4dac-8afd-ae44ec1c951a service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:46.131114 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3a47-c939-4dac-8afd-ae44ec1c951a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:46.132800 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-61d08444-7b1b-4825-85de-4a4601fbe2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:46.135122 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ba0d3a47-c939-4dac-8afd-ae44ec1c951a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:46.235134 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d3a47-c939-4dac-8afd-ae44ec1c951a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:46.235395 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d08444-7b1b-4825-85de-4a4601fbe2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:46.236644 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d08444-7b1b-4825-85de-4a4601fbe2b5 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:46.237055 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d3a47-c939-4dac-8afd-ae44ec1c951a service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:46.250584 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1390/2795] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:45:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:45:46.255092 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1406/2796] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:45:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:45:46.673848 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d3a47-c939-4dac-8afd-ae44ec1c951a service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:46.682266 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d3a47-c939-4dac-8afd-ae44ec1c951a service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:46.685857 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596bb3d-bb14-4f86-99f7-8f4dd02d151d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:46.686515 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596bb3d-bb14-4f86-99f7-8f4dd02d151d service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:46.686818 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596bb3d-bb14-4f86-99f7-8f4dd02d151d service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:46.687093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596bb3d-bb14-4f86-99f7-8f4dd02d151d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:46.688823 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-7596bb3d-bb14-4f86-99f7-8f4dd02d151d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:46.749148 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596bb3d-bb14-4f86-99f7-8f4dd02d151d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:46.750597 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596bb3d-bb14-4f86-99f7-8f4dd02d151d service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:46.759669 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1391/2797] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:45:46 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:45:50.002037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d08444-7b1b-4825-85de-4a4601fbe2b5 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:50.010807 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d08444-7b1b-4825-85de-4a4601fbe2b5 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:50.014556 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05c2c4-9387-4449-8e19-601977627f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:50.015430 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05c2c4-9387-4449-8e19-601977627f22 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:50.015720 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05c2c4-9387-4449-8e19-601977627f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:50.015988 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05c2c4-9387-4449-8e19-601977627f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:50.017776 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7f05c2c4-9387-4449-8e19-601977627f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:50.084780 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05c2c4-9387-4449-8e19-601977627f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:50.090830 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05c2c4-9387-4449-8e19-601977627f22 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:50.096471 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1407/2798] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:45:50 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:45:50.445901 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596bb3d-bb14-4f86-99f7-8f4dd02d151d service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:50.454909 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596bb3d-bb14-4f86-99f7-8f4dd02d151d service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:50.458507 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae891035-7d76-46ed-be6a-1d31df29f4ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:50.459142 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891035-7d76-46ed-be6a-1d31df29f4ff service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:50.459419 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891035-7d76-46ed-be6a-1d31df29f4ff service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:50.459691 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891035-7d76-46ed-be6a-1d31df29f4ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:50.461595 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-ae891035-7d76-46ed-be6a-1d31df29f4ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:50.523751 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae891035-7d76-46ed-be6a-1d31df29f4ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:50.525174 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae891035-7d76-46ed-be6a-1d31df29f4ff service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:50.535532 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1392/2799] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:45:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:45:58.251142 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05c2c4-9387-4449-8e19-601977627f22 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:58.252594 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-7f05c2c4-9387-4449-8e19-601977627f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:58.267878 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05c2c4-9387-4449-8e19-601977627f22 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:58.272551 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:58.273418 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:58.273701 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:58.274024 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] PATH_INFO: `/v3/users/0adbeb55b1054c2daf6932831854a4a7` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:58.275218 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0adbeb55b1054c2daf6932831854a4a7)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:58.277204 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:58.463357 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0adbeb55b1054c2daf6932831854a4a7'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:58.463996 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0adbeb55b1054c2daf6932831854a4a7'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:58.464588 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0adbeb55b1054c2daf6932831854a4a7'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:58.530309 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0adbeb55b1054c2daf6932831854a4a7'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:58.541852 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0adbeb55b1054c2daf6932831854a4a7'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:58.554155 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1408/2800] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:45:58 2021] DELETE /identity/v3/users/0adbeb55b1054c2daf6932831854a4a7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:45:58.777166 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae891035-7d76-46ed-be6a-1d31df29f4ff service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:58.789135 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae891035-7d76-46ed-be6a-1d31df29f4ff service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:58.845394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:58.846274 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:58.846819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:58.847089 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] PATH_INFO: `/v3/projects/236affd94e314d68a10b2decd9cafcd1` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:58.848255 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=236affd94e314d68a10b2decd9cafcd1)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:58.850173 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:58.952736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236affd94e314d68a10b2decd9cafcd1', 'request_id': 'req-5b37cd24-ce10-4d3d-a431-ef33a971d366'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.055954 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236affd94e314d68a10b2decd9cafcd1', 'request_id': 'req-5b37cd24-ce10-4d3d-a431-ef33a971d366'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.061529 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236affd94e314d68a10b2decd9cafcd1', 'request_id': 'req-5b37cd24-ce10-4d3d-a431-ef33a971d366'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.072466 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] The token cache is being invalidate because project 236affd94e314d68a10b2decd9cafcd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:45:59.072748 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.073368 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.074996 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1393/2801] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:45:58 2021] DELETE /identity/v3/projects/236affd94e314d68a10b2decd9cafcd1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:45:59.079062 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:59.080428 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:59.093723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850af88a-a6ea-4d8c-bf28-588bc9de67ac admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:59.146369 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:59.147230 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:59.147506 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:59.147772 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] PATH_INFO: `/v3/users/2b55b6a77ab84e4c928f3d4ad910f5d4` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:59.148922 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b55b6a77ab84e4c928f3d4ad910f5d4)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:59.150917 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:59.282343 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b55b6a77ab84e4c928f3d4ad910f5d4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.283073 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b55b6a77ab84e4c928f3d4ad910f5d4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.283596 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b55b6a77ab84e4c928f3d4ad910f5d4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.341488 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b55b6a77ab84e4c928f3d4ad910f5d4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.353672 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b55b6a77ab84e4c928f3d4ad910f5d4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.365410 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1409/2802] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:45:59 2021] DELETE /identity/v3/users/2b55b6a77ab84e4c928f3d4ad910f5d4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:45:59.607168 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:45:59.609042 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:45:59.625375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37cd24-ce10-4d3d-a431-ef33a971d366 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:45:59.682414 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:45:59.683265 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:45:59.683542 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:45:59.683817 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] PATH_INFO: `/v3/projects/c6a477f2fe9247dda16e104af2119881` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:45:59.685030 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6a477f2fe9247dda16e104af2119881)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:45:59.687614 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:45:59.781485 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6a477f2fe9247dda16e104af2119881', 'request_id': 'req-03ef5231-94ab-402c-99ac-3f492e6fc75a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.833044 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6a477f2fe9247dda16e104af2119881', 'request_id': 'req-03ef5231-94ab-402c-99ac-3f492e6fc75a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.838640 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6a477f2fe9247dda16e104af2119881', 'request_id': 'req-03ef5231-94ab-402c-99ac-3f492e6fc75a'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.849835 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] The token cache is being invalidate because project c6a477f2fe9247dda16e104af2119881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:45:59.850093 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.850714 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:45:59.852229 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1394/2803] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:45:59 2021] DELETE /identity/v3/projects/c6a477f2fe9247dda16e104af2119881 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:47:00.748155 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:47:00.749713 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:47:00.805904 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa5b00-14b5-4b8b-a678-fd7720ae4815 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:47:00.853999 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249c5ec-e67e-448f-8db3-655623d7048a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:47:00.854643 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c5ec-e67e-448f-8db3-655623d7048a service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:47:00.854925 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c5ec-e67e-448f-8db3-655623d7048a service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:47:00.855199 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c5ec-e67e-448f-8db3-655623d7048a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:47:00.857487 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-e249c5ec-e67e-448f-8db3-655623d7048a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:47:00.866737 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249c5ec-e67e-448f-8db3-655623d7048a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:47:00.868159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249c5ec-e67e-448f-8db3-655623d7048a service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:47:00.876815 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1410/2804] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:47:00 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:47:46.500269 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:47:46.501681 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:47:46.585440 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef5231-94ab-402c-99ac-3f492e6fc75a admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:47:46.592196 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84e093-cecf-4f22-bfe4-8ce2406bf381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:47:46.592977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84e093-cecf-4f22-bfe4-8ce2406bf381 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:47:46.593259 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84e093-cecf-4f22-bfe4-8ce2406bf381 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:47:46.593535 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84e093-cecf-4f22-bfe4-8ce2406bf381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:47:46.595797 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0e84e093-cecf-4f22-bfe4-8ce2406bf381 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:47:46.612656 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84e093-cecf-4f22-bfe4-8ce2406bf381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:47:46.612656 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84e093-cecf-4f22-bfe4-8ce2406bf381 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:47:46.624610 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1395/2805] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:47:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:47:48.535955 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e6058-335a-4b15-983c-7982283d0f85 None None] REQUEST_METHOD: `POST` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:47:48.536555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e6058-335a-4b15-983c-7982283d0f85 None None] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:47:48.536555 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e6058-335a-4b15-983c-7982283d0f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:47:48.553143 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.auth.core [None req-2d9e6058-335a-4b15-983c-7982283d0f85 None None] MFA Rules not processed for user `1942620c43074465ac1304b4760f6526`. Rule list: `[]` (Enabled: `True`). {{(pid=73673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:47:48.554349 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2d9e6058-335a-4b15-983c-7982283d0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:47:48.609335 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1411/2806] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:47:48 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:47:48.911553 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84e093-cecf-4f22-bfe4-8ce2406bf381 service nova] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:47:48.913043 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-0e84e093-cecf-4f22-bfe4-8ce2406bf381 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:47:48.924246 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84e093-cecf-4f22-bfe4-8ce2406bf381 service nova] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:47:48.927914 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccee301-943d-4235-945b-d7f1144efbd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:47:48.928549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccee301-943d-4235-945b-d7f1144efbd2 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:47:48.928826 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccee301-943d-4235-945b-d7f1144efbd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:47:48.929281 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccee301-943d-4235-945b-d7f1144efbd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:47:48.931242 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-4ccee301-943d-4235-945b-d7f1144efbd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:47:48.942271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccee301-943d-4235-945b-d7f1144efbd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:47:48.943737 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccee301-943d-4235-945b-d7f1144efbd2 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:47:48.952366 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1396/2807] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:47:48 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:47:49.708407 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e6058-335a-4b15-983c-7982283d0f85 None None] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:47:49.714461 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-2d9e6058-335a-4b15-983c-7982283d0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:47:49.778560 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e6058-335a-4b15-983c-7982283d0f85 None None] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:47:49.783683 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ceddd-43ef-4d2c-bf01-f6acedd4854e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77a408df11844e2aacbb366019dc3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:47:49.784322 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ceddd-43ef-4d2c-bf01-f6acedd4854e service placement] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:47:49.784600 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ceddd-43ef-4d2c-bf01-f6acedd4854e service placement] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:47:49.784869 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ceddd-43ef-4d2c-bf01-f6acedd4854e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:47:49.786587 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-305ceddd-43ef-4d2c-bf01-f6acedd4854e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:47:49.798238 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ceddd-43ef-4d2c-bf01-f6acedd4854e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:47:49.801583 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ceddd-43ef-4d2c-bf01-f6acedd4854e service placement] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:47:49.809723 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1412/2808] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:47:49 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:48:04.464977 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccee301-943d-4235-945b-d7f1144efbd2 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:48:04.478968 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccee301-943d-4235-945b-d7f1144efbd2 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:48:04.486191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df781120-c270-467b-b0d3-5c02d1e6ec58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c0afa8f09f4923b9c8ab2696156129', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:48:04.486191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df781120-c270-467b-b0d3-5c02d1e6ec58 service nova] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:48:04.486191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df781120-c270-467b-b0d3-5c02d1e6ec58 service nova] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:48:04.486191 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df781120-c270-467b-b0d3-5c02d1e6ec58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:48:04.487422 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-df781120-c270-467b-b0d3-5c02d1e6ec58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:48:04.500281 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df781120-c270-467b-b0d3-5c02d1e6ec58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:48:04.501833 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df781120-c270-467b-b0d3-5c02d1e6ec58 service nova] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:48:04.512069 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1397/2809] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:48:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:49:07.042060 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ceddd-43ef-4d2c-bf01-f6acedd4854e service placement] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:49:07.043433 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-305ceddd-43ef-4d2c-bf01-f6acedd4854e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:49:07.125887 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ceddd-43ef-4d2c-bf01-f6acedd4854e service placement] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:49:07.130943 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903d188-b768-4873-9f2b-95f78f318f7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77a408df11844e2aacbb366019dc3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:49:07.131574 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903d188-b768-4873-9f2b-95f78f318f7b service placement] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:49:07.131853 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903d188-b768-4873-9f2b-95f78f318f7b service placement] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:49:07.132290 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903d188-b768-4873-9f2b-95f78f318f7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:49:07.134037 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-3903d188-b768-4873-9f2b-95f78f318f7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:49:07.144946 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903d188-b768-4873-9f2b-95f78f318f7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:49:07.146554 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903d188-b768-4873-9f2b-95f78f318f7b service placement] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:49:07.156060 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1413/2810] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:49:07 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:49:48.036394 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402f894-2fbb-4072-97a4-624a5c981406 None None] REQUEST_METHOD: `POST` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:49:48.036904 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402f894-2fbb-4072-97a4-624a5c981406 None None] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:49:48.037016 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402f894-2fbb-4072-97a4-624a5c981406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:49:48.054421 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.auth.core [None req-a402f894-2fbb-4072-97a4-624a5c981406 None None] MFA Rules not processed for user `1942620c43074465ac1304b4760f6526`. Rule list: `[]` (Enabled: `True`). {{(pid=73674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 14:49:48.055612 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-a402f894-2fbb-4072-97a4-624a5c981406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:49:48.062438 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1398/2811] 10.222.0.16 () {58 vars in 958 bytes} [Sun Aug 29 14:49:48 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 14:49:48.372744 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903d188-b768-4873-9f2b-95f78f318f7b service placement] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:49:48.392281 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903d188-b768-4873-9f2b-95f78f318f7b service placement] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:49:48.396443 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4599937-b1f2-452e-a473-56f64a8d5521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:49:48.397076 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4599937-b1f2-452e-a473-56f64a8d5521 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:49:48.397351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4599937-b1f2-452e-a473-56f64a8d5521 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:49:48.397621 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4599937-b1f2-452e-a473-56f64a8d5521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:49:48.399376 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-a4599937-b1f2-452e-a473-56f64a8d5521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:49:48.420782 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4599937-b1f2-452e-a473-56f64a8d5521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:49:48.422224 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4599937-b1f2-452e-a473-56f64a8d5521 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:49:48.430175 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1414/2812] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:49:48 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 14:51:48.445161 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402f894-2fbb-4072-97a4-624a5c981406 None None] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:51:48.454800 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402f894-2fbb-4072-97a4-624a5c981406 None None] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:51:48.458359 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fbd75-e724-4b6d-87d7-c9a74cde1bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:51:48.458989 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fbd75-e724-4b6d-87d7-c9a74cde1bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:51:48.459269 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fbd75-e724-4b6d-87d7-c9a74cde1bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:51:48.459542 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fbd75-e724-4b6d-87d7-c9a74cde1bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:51:48.461270 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1e2fbd75-e724-4b6d-87d7-c9a74cde1bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:51:48.474181 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fbd75-e724-4b6d-87d7-c9a74cde1bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:51:48.475525 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fbd75-e724-4b6d-87d7-c9a74cde1bb7 service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:51:48.484663 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1399/2813] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:51:48 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:51:50.034602 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4599937-b1f2-452e-a473-56f64a8d5521 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:51:50.044665 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4599937-b1f2-452e-a473-56f64a8d5521 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:51:50.048536 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6ae6f-0672-40f7-96e4-3e34851609d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:51:50.049180 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6ae6f-0672-40f7-96e4-3e34851609d5 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:51:50.049456 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6ae6f-0672-40f7-96e4-3e34851609d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:51:50.049873 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6ae6f-0672-40f7-96e4-3e34851609d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:51:50.051941 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5da6ae6f-0672-40f7-96e4-3e34851609d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:51:50.085788 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6ae6f-0672-40f7-96e4-3e34851609d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:51:50.088272 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6ae6f-0672-40f7-96e4-3e34851609d5 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:51:50.110324 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1415/2814] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:51:50 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:51:51.384511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fbd75-e724-4b6d-87d7-c9a74cde1bb7 service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:51:51.392934 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fbd75-e724-4b6d-87d7-c9a74cde1bb7 service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:51:51.396558 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29285b-5eb4-4adb-ac1f-5f7478919f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:51:51.397185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29285b-5eb4-4adb-ac1f-5f7478919f3d service neutron] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:51:51.397460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29285b-5eb4-4adb-ac1f-5f7478919f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:51:51.397729 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29285b-5eb4-4adb-ac1f-5f7478919f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:51:51.399731 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1c29285b-5eb4-4adb-ac1f-5f7478919f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:51:51.413063 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29285b-5eb4-4adb-ac1f-5f7478919f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:51:51.414549 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29285b-5eb4-4adb-ac1f-5f7478919f3d service neutron] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:51:51.426002 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1400/2815] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:51:51 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:52:04.361825 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6ae6f-0672-40f7-96e4-3e34851609d5 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:52:04.363278 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-5da6ae6f-0672-40f7-96e4-3e34851609d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:52:04.378167 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6ae6f-0672-40f7-96e4-3e34851609d5 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:52:04.382288 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3be661-3dac-4ddc-9eac-dc79fcb44885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f13a39de23f04cb0a2f5b050d740334a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:52:04.382919 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3be661-3dac-4ddc-9eac-dc79fcb44885 service neutron] REQUEST_METHOD: `GET` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:52:04.383196 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3be661-3dac-4ddc-9eac-dc79fcb44885 service neutron] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:52:04.384051 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3be661-3dac-4ddc-9eac-dc79fcb44885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:52:04.385763 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-6f3be661-3dac-4ddc-9eac-dc79fcb44885 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:52:04.465702 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3be661-3dac-4ddc-9eac-dc79fcb44885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:52:04.467159 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3be661-3dac-4ddc-9eac-dc79fcb44885 service neutron] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:52:04.485474 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1416/2816] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:52:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 14:52:11.874212 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29285b-5eb4-4adb-ac1f-5f7478919f3d service neutron] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:52:11.876253 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-1c29285b-5eb4-4adb-ac1f-5f7478919f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:52:11.890985 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29285b-5eb4-4adb-ac1f-5f7478919f3d service neutron] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:52:11.895651 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:52:11.896460 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:52:11.896736 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:52:11.897011 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] PATH_INFO: `/v3/users/1942620c43074465ac1304b4760f6526` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:52:11.898225 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1942620c43074465ac1304b4760f6526)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:52:11.900814 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:52:12.078586 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1942620c43074465ac1304b4760f6526'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:12.079271 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1942620c43074465ac1304b4760f6526'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:12.085821 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1942620c43074465ac1304b4760f6526'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:12.150127 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1942620c43074465ac1304b4760f6526'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:12.161716 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1942620c43074465ac1304b4760f6526'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:12.167649 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1401/2817] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:52:11 2021] DELETE /identity/v3/users/1942620c43074465ac1304b4760f6526 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:52:12.410356 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3be661-3dac-4ddc-9eac-dc79fcb44885 service neutron] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:52:12.421400 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3be661-3dac-4ddc-9eac-dc79fcb44885 service neutron] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:52:12.479613 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:52:12.480477 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:52:12.480789 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:52:12.481067 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] PATH_INFO: `/v3/projects/a000df0ea44b455795a3f49fdbbbbd1c` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:52:12.482284 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a000df0ea44b455795a3f49fdbbbbd1c)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:52:12.484189 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:52:12.585384 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a000df0ea44b455795a3f49fdbbbbd1c', 'request_id': 'req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:12.654021 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a000df0ea44b455795a3f49fdbbbbd1c', 'request_id': 'req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:12.662132 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a000df0ea44b455795a3f49fdbbbbd1c', 'request_id': 'req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:12.675366 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] The token cache is being invalidate because project a000df0ea44b455795a3f49fdbbbbd1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:52:12.675655 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:12.676307 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:12.678458 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1417/2818] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:52:12 2021] DELETE /identity/v3/projects/a000df0ea44b455795a3f49fdbbbbd1c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:52:12.683243 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:52:12.684619 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:52:12.697219 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de42364-9d94-4022-9b0e-8fbc96f67c68 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:52:12.751453 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:52:12.752637 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:52:12.753035 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:52:12.753316 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] PATH_INFO: `/v3/users/7e6f97e029004028b0b8f91789b5ef9b` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:52:12.754853 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6f97e029004028b0b8f91789b5ef9b)` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:52:12.757589 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:52:12.935200 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6f97e029004028b0b8f91789b5ef9b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:12.935967 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6f97e029004028b0b8f91789b5ef9b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:12.942742 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6f97e029004028b0b8f91789b5ef9b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:13.019898 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6f97e029004028b0b8f91789b5ef9b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:13.032829 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.notifications [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6f97e029004028b0b8f91789b5ef9b'} {{(pid=73674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:13.038979 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1402/2819] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Aug 29 14:52:12 2021] DELETE /identity/v3/users/7e6f97e029004028b0b8f91789b5ef9b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:52:13.245740 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] Authenticating user token {{(pid=73673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:52:13.247274 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.fernet_utils [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:52:13.263540 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddf5f3-ad40-4ec4-af3b-389a2af98541 admin admin] Validating token access rules against request {{(pid=73673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:52:13.318124 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f8f7fa57374efdb2df20708faea2ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ee3fdc9b9a0424b897a4f05d6b3569f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:52:13.319061 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:52:13.319342 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:52:13.319616 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4 admin admin] PATH_INFO: `/v3/projects/443082d158ca4e1cb0a8e677212e3f7f` {{(pid=73673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:52:13.321575 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=443082d158ca4e1cb0a8e677212e3f7f)` {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:52:13.323518 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4 admin admin] RBAC: Authorization granted {{(pid=73673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:52:13.431632 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443082d158ca4e1cb0a8e677212e3f7f', 'request_id': 'req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:13.515277 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443082d158ca4e1cb0a8e677212e3f7f', 'request_id': 'req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:13.521109 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443082d158ca4e1cb0a8e677212e3f7f', 'request_id': 'req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4'} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:13.532043 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4 admin admin] The token cache is being invalidate because project 443082d158ca4e1cb0a8e677212e3f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 14:52:13.532351 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:13.533016 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: DEBUG keystone.notifications [None req-ce0496e1-3eff-4407-a8f6-44fbc8f783b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 14:52:13.534684 dv-cinder-778193-6-iscsi devstack@keystone.service[73673]: [pid: 73673|app: 0|req: 1418/2820] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Aug 29 14:52:13 2021] DELETE /identity/v3/projects/443082d158ca4e1cb0a8e677212e3f7f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 14:54:10.999511 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] Authenticating user token {{(pid=73674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 14:54:11.001038 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:54:11.068123 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6972b-a102-493e-ac73-4954eef10535 admin admin] Validating token access rules against request {{(pid=73674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 14:54:11.124185 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51664ce9-dcc0-4940-9254-d0a4607c17d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b77a408df11844e2aacbb366019dc3d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c728e9160de45afbd4902c27eef45b3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 14:54:11.124819 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51664ce9-dcc0-4940-9254-d0a4607c17d2 service placement] REQUEST_METHOD: `GET` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 14:54:11.125100 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51664ce9-dcc0-4940-9254-d0a4607c17d2 service placement] SCRIPT_NAME: `/identity` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 14:54:11.125375 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51664ce9-dcc0-4940-9254-d0a4607c17d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 14:54:11.127116 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.fernet_utils [None req-51664ce9-dcc0-4940-9254-d0a4607c17d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 14:54:11.137953 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51664ce9-dcc0-4940-9254-d0a4607c17d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 14:54:11.139520 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51664ce9-dcc0-4940-9254-d0a4607c17d2 service placement] RBAC: Authorization granted {{(pid=73674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 14:54:11.149148 dv-cinder-778193-6-iscsi devstack@keystone.service[73674]: [pid: 73674|app: 0|req: 1403/2821] 10.222.0.16 () {60 vars in 1366 bytes} [Sun Aug 29 14:54:10 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)